2023-06-09T04:22:11.178 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T04:22:11.179 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --archive /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299734 --name xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi --owner scheduled_xiubli@teuthology --verbose -- /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299734/orig.config.yaml 2023-06-09T04:22:11.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T04:22:11.313 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299734 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7299734' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi104.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-09_04:16:27 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-09T04:22:11.313 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-09T04:22:11.314 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-09T04:22:11.314 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-09T04:22:11.316 INFO:teuthology.task.internal:Checking packages... 2023-06-09T04:22:11.343 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-09T04:22:11.343 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-09T04:22:11.344 INFO:teuthology.packaging:ref: None 2023-06-09T04:22:11.344 INFO:teuthology.packaging:tag: None 2023-06-09T04:22:11.344 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-09T04:22:11.345 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:22:11.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-09T04:22:11.565 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313.ga02638f8 2023-06-09T04:22:11.566 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-09T04:22:11.573 INFO:teuthology.task.internal:no buildpackages task found 2023-06-09T04:22:11.574 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-09T04:22:11.583 INFO:teuthology.task.internal:Saving configuration 2023-06-09T04:22:11.598 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-09T04:22:11.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T04:22:11.634 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299734', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:33.001728', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-09T04:22:11.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299734', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:33.000227', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-09T04:22:11.656 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-09T04:22:11.669 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-09T04:22:11.669 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-09T04:22:11.669 INFO:teuthology.run_tasks:Running task console_log... 2023-06-09T04:22:11.744 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7154d5cf70>, signals=[15]) 2023-06-09T04:22:11.745 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-09T04:22:11.757 INFO:teuthology.task.internal:Opening connections... 2023-06-09T04:22:11.757 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:22:11.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:22:11.828 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:22:11.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:22:11.895 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-09T04:22:11.904 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-06-09T04:22:11.926 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-06-09T04:22:11.926 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-06-09T04:22:11.985 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T04:22:11.986 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T04:22:11.987 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T04:22:11.988 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T04:22:11.988 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-06-09T04:22:12.011 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-06-09T04:22:12.031 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-06-09T04:22:12.031 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-06-09T04:22:12.090 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T04:22:12.090 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T04:22:12.090 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T04:22:12.091 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T04:22:12.092 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T04:22:12.093 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-09T04:22:12.118 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-09T04:22:12.132 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-09T04:22:12.154 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-09T04:22:12.154 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:22:12.157 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:22:12.174 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-09T04:22:12.188 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-09T04:22:12.188 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:22:12.216 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:22:12.245 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-09T04:22:12.315 INFO:teuthology.run_tasks:Running task kernel... 2023-06-09T04:22:12.336 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-09T04:22:12.337 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-09T04:22:12.337 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:22:12.338 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:22:12.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:22:12.356 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2023-06-09T04:22:12.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:22:12.358 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-06-09T04:22:12.414 INFO:teuthology.orchestra.run.smithi104.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:12.414 INFO:teuthology.task.kernel:Running kernel on smithi104: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:12.414 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2023-06-09T04:22:12.417 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:12.418 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:12.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2023-06-09T04:22:13.540 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2023-06-09T04:22:13.540 INFO:teuthology.orchestra.run.smithi104.stdout:Unable to read consumer identity 2023-06-09T04:22:13.690 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-06-09T04:22:13.690 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-06-09T04:22:17.579 INFO:teuthology.orchestra.run.smithi104.stdout:Copr repo for python3-asyncssh owned by ceph 1.2 kB/s | 3.5 kB 00:02 2023-06-09T04:22:17.618 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-09T04:22:18.472 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-06-09T04:22:18.818 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-09T04:22:21.929 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 417 kB/s | 24 kB 00:00 2023-06-09T04:22:22.452 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 590 kB/s | 24 kB 00:00 2023-06-09T04:22:22.606 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-06-09T04:22:22.653 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2023-06-09T04:22:22.654 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2023-06-09T04:22:22.655 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2023-06-09T04:22:22.775 DEBUG:teuthology.orchestra.run.smithi104:> echo no | sudo yum reinstall kernel || true 2023-06-09T04:22:23.144 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2023-06-09T04:22:23.145 INFO:teuthology.orchestra.run.smithi104.stdout:Unable to read consumer identity 2023-06-09T04:22:23.187 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-06-09T04:22:23.244 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-06-09T04:22:23.245 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2023-06-09T04:22:23.245 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-06-09T04:22:23.375 DEBUG:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2023-06-09T04:22:23.398 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:02 ago on Fri 09 Jun 2023 04:22:21 AM UTC. 2023-06-09T04:22:23.439 INFO:teuthology.orchestra.run.smithi104.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:22:23.476 INFO:teuthology.orchestra.run.smithi104.stderr:Error: No packages marked for reinstall. 2023-06-09T04:22:23.522 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum reinstall -y kernel || true 2023-06-09T04:22:23.726 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-06-09T04:22:23.726 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-06-09T04:22:23.850 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2023-06-09T04:22:23.850 INFO:teuthology.orchestra.run.smithi104.stdout:Unable to read consumer identity 2023-06-09T04:22:23.993 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:01 ago on Fri 09 Jun 2023 04:22:22 AM UTC. 2023-06-09T04:22:24.042 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:22:24.089 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-06-09T04:22:24.105 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:03 ago on Fri 09 Jun 2023 04:22:21 AM UTC. 2023-06-09T04:22:24.137 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2023-06-09T04:22:24.148 INFO:teuthology.orchestra.run.smithi104.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:22:24.169 INFO:teuthology.orchestra.run.smithi104.stderr:Error: No packages marked for reinstall. 2023-06-09T04:22:24.219 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2023-06-09T04:22:24.300 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:24.300 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:24.300 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-06-09T04:22:24.301 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-09T04:22:24.301 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-09T04:22:24.329 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2023-06-09T04:22:24.341 DEBUG:teuthology.parallel:result is None 2023-06-09T04:22:24.486 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-06-09T04:22:24.486 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-06-09T04:22:24.749 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Fri 09 Jun 2023 04:22:22 AM UTC. 2023-06-09T04:22:24.794 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:22:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-06-09T04:22:24.866 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-06-09T04:22:24.949 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:24.950 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:22:24.950 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-06-09T04:22:24.950 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-09T04:22:24.951 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-09T04:22:24.984 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2023-06-09T04:22:24.999 DEBUG:teuthology.parallel:result is None 2023-06-09T04:22:24.999 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-09T04:22:25.013 INFO:teuthology.task.internal:Creating test directory... 2023-06-09T04:22:25.014 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:22:25.041 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:22:25.061 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-09T04:22:25.068 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-09T04:22:25.081 INFO:teuthology.task.internal:Creating archive directory... 2023-06-09T04:22:25.081 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:22:25.098 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:22:25.125 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-09T04:22:25.132 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-09T04:22:25.132 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:22:25.156 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:22:25.200 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:22:25.210 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:22:25.211 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:22:25.222 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:22:25.223 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-09T04:22:25.230 INFO:teuthology.task.internal:Configuring sudo... 2023-06-09T04:22:25.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:22:25.233 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:22:25.262 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-09T04:22:25.276 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-09T04:22:25.276 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:22:25.301 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:22:25.319 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:22:25.402 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:22:25.452 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:22:25.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:22:25.578 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:22:25.579 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:22:25.646 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:22:25.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:22:25.747 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:22:25.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:22:25.878 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:22:25.878 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:22:25.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-06-09T04:22:25.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2023-06-09T04:22:26.037 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-09T04:22:26.042 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-09T04:22:26.519 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-09T04:22:26.527 INFO:teuthology.task.internal:Starting timer... 2023-06-09T04:22:26.527 INFO:teuthology.run_tasks:Running task pcp... 2023-06-09T04:22:26.538 INFO:teuthology.run_tasks:Running task selinux... 2023-06-09T04:22:26.550 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-09T04:22:26.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2023-06-09T04:22:26.602 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2023-06-09T04:22:26.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2023-06-09T04:22:26.668 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2023-06-09T04:22:26.670 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-09T04:22:26.670 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2023-06-09T04:22:26.697 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2023-06-09T04:22:26.697 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2023-06-09T04:22:26.717 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2023-06-09T04:22:26.717 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi104.front.sepia.ceph.com': 'permissive'} 2023-06-09T04:22:26.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-09T04:22:26.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:22:26.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-09T04:22:26.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:22:26.795 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-09T04:22:26.795 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2023-06-09T04:22:26.845 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2023-06-09T04:22:26.873 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-09T04:22:26.883 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-09T04:22:26.889 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-09T04:22:27.017 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-09T04:22:27.034 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-09T04:22:27.036 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi104.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-09T04:34:53.288 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com')] 2023-06-09T04:34:53.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-06-09T04:34:53.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:34:53.358 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-06-09T04:34:53.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-06-09T04:34:53.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:34:53.492 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-06-09T04:34:53.561 INFO:teuthology.run_tasks:Running task clock... 2023-06-09T04:34:53.571 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-09T04:34:53.572 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:34:53.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:34:53.575 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:34:53.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:34:53.606 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-09T04:34:53.622 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-09T04:34:53.633 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-09T04:34:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-09T04:34:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2023-06-09T04:34:53.717 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2023-06-09T04:34:53.726 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2023-06-09T04:34:53.728 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2023-06-09T04:34:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-09T04:34:53.742 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-09T04:34:53.756 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-09T04:34:53.757 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-09T04:34:53.823 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-06-09T04:34:53.826 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-09T04:34:53.826 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-06-09T04:34:53.826 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.827 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.827 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.827 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.869 INFO:teuthology.orchestra.run.smithi104.stderr:bash: ntpq: command not found 2023-06-09T04:34:53.872 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-09T04:34:53.872 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2023-06-09T04:34:53.873 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.873 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.873 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.873 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:34:53.874 INFO:teuthology.run_tasks:Running task install... 2023-06-09T04:34:53.882 DEBUG:teuthology.task.install:project ceph 2023-06-09T04:34:53.882 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-09T04:34:53.883 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-09T04:34:53.883 INFO:teuthology.task.install:Using flavor: default 2023-06-09T04:34:53.888 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-09T04:34:53.889 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-09T04:34:53.889 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-09T04:34:53.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:34:53.892 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-09T04:34:53.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:34:54.031 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-09T04:34:54.031 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-09T04:34:54.141 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-09T04:34:54.141 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-09T04:34:54.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-09T04:34:54.208 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:34:54.208 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-09T04:34:54.236 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-09T04:34:54.236 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-09T04:34:54.303 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-09T04:34:54.306 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-09T04:34:54.306 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:34:54.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-09T04:34:54.338 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-09T04:34:54.339 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-09T04:34:54.379 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-09T04:34:54.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-09T04:34:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2023-06-09T04:34:54.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2023-06-09T04:34:54.490 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-09T04:34:54.557 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2023-06-09T04:34:54.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2023-06-09T04:34:54.814 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2023-06-09T04:34:54.953 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-06-09T04:34:55.064 INFO:teuthology.orchestra.run.smithi104.stdout:44 files removed 2023-06-09T04:34:55.110 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-09T04:34:55.193 INFO:teuthology.orchestra.run.smithi026.stdout:44 files removed 2023-06-09T04:34:55.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-09T04:34:55.438 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2023-06-09T04:34:55.588 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-06-09T04:34:56.219 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 199 kB/s | 80 kB 00:00 2023-06-09T04:34:56.476 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 161 kB/s | 80 kB 00:00 2023-06-09T04:34:56.662 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2023-06-09T04:34:56.876 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-06-09T04:34:57.021 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2023-06-09T04:34:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-06-09T04:34:59.554 INFO:teuthology.orchestra.run.smithi104.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-09T04:34:59.761 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-09T04:35:03.511 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 16 MB 00:03 2023-06-09T04:35:07.161 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-06-09T04:35:08.171 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 MB/s | 53 MB 00:00 2023-06-09T04:35:09.614 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 16 MB 00:10 2023-06-09T04:35:13.044 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-06-09T04:35:13.971 INFO:teuthology.orchestra.run.smithi104.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-06-09T04:35:16.874 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 MB/s | 47 MB 00:00 2023-06-09T04:35:22.171 INFO:teuthology.orchestra.run.smithi104.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 MB/s | 47 MB 00:00 2023-06-09T04:35:28.531 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:35:28.532 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:35:28.547 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-09T04:35:28.548 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-09T04:35:28.549 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-09T04:35:28.550 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:35:28.552 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:35:28.556 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-09T04:35:28.557 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:35:28.703 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-06-09T04:35:28.717 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================================================== 2023-06-09T04:35:28.717 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-06-09T04:35:28.717 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================================================== 2023-06-09T04:35:28.717 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-06-09T04:35:28.717 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-09T04:35:28.718 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-09T04:35:28.719 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-09T04:35:28.720 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-09T04:35:28.721 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-09T04:35:28.722 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-06-09T04:35:28.723 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-09T04:35:28.724 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-09T04:35:28.725 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-09T04:35:28.726 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-09T04:35:28.727 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-09T04:35:28.728 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-09T04:35:28.729 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-09T04:35:28.730 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-09T04:35:28.732 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-09T04:35:28.733 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-09T04:35:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-09T04:35:28.736 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling module streams: 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql 10 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================================================== 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout:Install 128 Packages 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 3 Packages 2023-06-09T04:35:28.737 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:35:28.738 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 197 M 2023-06-09T04:35:28.738 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-06-09T04:35:29.324 INFO:teuthology.orchestra.run.smithi026.stdout:(1/131): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-06-09T04:35:29.608 INFO:teuthology.orchestra.run.smithi026.stdout:(2/131): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 2.9 MB/s | 848 kB 00:00 2023-06-09T04:35:29.684 INFO:teuthology.orchestra.run.smithi026.stdout:(3/131): ceph-immutable-object-cache-18.0.0-431 2.2 MB/s | 166 kB 00:00 2023-06-09T04:35:30.025 INFO:teuthology.orchestra.run.smithi026.stdout:(4/131): ceph-base-18.0.0-4313.ga02638f8.el8.x8 6.1 MB/s | 5.4 MB 00:00 2023-06-09T04:35:30.075 INFO:teuthology.orchestra.run.smithi026.stdout:(5/131): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 5.8 MB/s | 2.3 MB 00:00 2023-06-09T04:35:30.225 INFO:teuthology.orchestra.run.smithi026.stdout:(6/131): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 7.8 MB/s | 1.5 MB 00:00 2023-06-09T04:35:30.817 INFO:teuthology.orchestra.run.smithi026.stdout:(7/131): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 6.2 MB/s | 4.6 MB 00:00 2023-06-09T04:35:32.601 INFO:teuthology.orchestra.run.smithi026.stdout:(8/131): ceph-osd-18.0.0-4313.ga02638f8.el8.x86 7.5 MB/s | 18 MB 00:02 2023-06-09T04:35:32.776 INFO:teuthology.orchestra.run.smithi026.stdout:(9/131): ceph-radosgw-18.0.0-4313.ga02638f8.el8 6.7 MB/s | 13 MB 00:01 2023-06-09T04:35:32.801 INFO:teuthology.orchestra.run.smithi026.stdout:(10/131): ceph-selinux-18.0.0-4313.ga02638f8.el 121 kB/s | 24 kB 00:00 2023-06-09T04:35:33.010 INFO:teuthology.orchestra.run.smithi026.stdout:(11/131): ceph-common-18.0.0-4313.ga02638f8.el8 5.6 MB/s | 22 MB 00:03 2023-06-09T04:35:33.035 INFO:teuthology.orchestra.run.smithi026.stdout:(12/131): cephfs-mirror-18.0.0-4313.ga02638f8.e 1.1 MB/s | 258 kB 00:00 2023-06-09T04:35:33.118 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:35:33.119 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:35:33.122 INFO:teuthology.orchestra.run.smithi026.stdout:(13/131): libcephfs-devel-18.0.0-4313.ga02638f8 276 kB/s | 31 kB 00:00 2023-06-09T04:35:33.133 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-09T04:35:33.134 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-09T04:35:33.135 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-09T04:35:33.136 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:35:33.138 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:35:33.141 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-09T04:35:33.143 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:35:33.261 INFO:teuthology.orchestra.run.smithi026.stdout:(14/131): libcephsqlite-18.0.0-4313.ga02638f8.e 996 kB/s | 137 kB 00:00 2023-06-09T04:35:33.271 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2023-06-09T04:35:33.284 INFO:teuthology.orchestra.run.smithi104.stdout:=========================================================================================================================== 2023-06-09T04:35:33.284 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2023-06-09T04:35:33.284 INFO:teuthology.orchestra.run.smithi104.stdout:=========================================================================================================================== 2023-06-09T04:35:33.284 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2023-06-09T04:35:33.284 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-09T04:35:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-09T04:35:33.286 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-09T04:35:33.287 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-09T04:35:33.287 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-09T04:35:33.287 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-09T04:35:33.287 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-09T04:35:33.288 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-09T04:35:33.289 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-09T04:35:33.290 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-09T04:35:33.291 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-09T04:35:33.292 INFO:teuthology.orchestra.run.smithi104.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-09T04:35:33.293 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-09T04:35:33.294 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-09T04:35:33.295 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-09T04:35:33.296 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-09T04:35:33.297 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-09T04:35:33.298 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-09T04:35:33.299 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-09T04:35:33.300 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-09T04:35:33.301 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-09T04:35:33.302 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout:Enabling module streams: 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql 10 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout:=========================================================================================================================== 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout:Install 128 Packages 2023-06-09T04:35:33.303 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 3 Packages 2023-06-09T04:35:33.304 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:35:33.304 INFO:teuthology.orchestra.run.smithi026.stdout:(15/131): libcephfs2-18.0.0-4313.ga02638f8.el8. 3.0 MB/s | 771 kB 00:00 2023-06-09T04:35:33.305 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 197 M 2023-06-09T04:35:33.305 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2023-06-09T04:35:33.361 INFO:teuthology.orchestra.run.smithi026.stdout:(16/131): librados-devel-18.0.0-4313.ga02638f8. 1.4 MB/s | 139 kB 00:00 2023-06-09T04:35:33.438 INFO:teuthology.orchestra.run.smithi104.stdout:(1/131): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 58 kB/s | 6.4 kB 00:00 2023-06-09T04:35:33.502 INFO:teuthology.orchestra.run.smithi026.stdout:(17/131): libradosstriper1-18.0.0-4313.ga02638f 2.2 MB/s | 473 kB 00:00 2023-06-09T04:35:33.587 INFO:teuthology.orchestra.run.smithi026.stdout:(18/131): python3-ceph-argparse-18.0.0-4313.ga0 525 kB/s | 45 kB 00:00 2023-06-09T04:35:33.695 INFO:teuthology.orchestra.run.smithi026.stdout:(19/131): python3-ceph-common-18.0.0-4313.ga026 1.1 MB/s | 119 kB 00:00 2023-06-09T04:35:33.729 INFO:teuthology.orchestra.run.smithi104.stdout:(2/131): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 2.8 MB/s | 848 kB 00:00 2023-06-09T04:35:33.796 INFO:teuthology.orchestra.run.smithi026.stdout:(20/131): python3-cephfs-18.0.0-4313.ga02638f8. 1.9 MB/s | 197 kB 00:00 2023-06-09T04:35:33.846 INFO:teuthology.orchestra.run.smithi104.stdout:(3/131): ceph-immutable-object-cache-18.0.0-431 1.4 MB/s | 166 kB 00:00 2023-06-09T04:35:33.930 INFO:teuthology.orchestra.run.smithi026.stdout:(21/131): python3-rados-18.0.0-4313.ga02638f8.e 2.7 MB/s | 370 kB 00:00 2023-06-09T04:35:34.313 INFO:teuthology.orchestra.run.smithi104.stdout:(4/131): ceph-base-18.0.0-4313.ga02638f8.el8.x8 5.5 MB/s | 5.4 MB 00:00 2023-06-09T04:35:34.439 INFO:teuthology.orchestra.run.smithi104.stdout:(5/131): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 3.9 MB/s | 2.3 MB 00:00 2023-06-09T04:35:34.563 INFO:teuthology.orchestra.run.smithi026.stdout:(22/131): python3-rbd-18.0.0-4313.ga02638f8.el8 576 kB/s | 365 kB 00:00 2023-06-09T04:35:34.589 INFO:teuthology.orchestra.run.smithi104.stdout:(6/131): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 5.6 MB/s | 1.5 MB 00:00 2023-06-09T04:35:34.847 INFO:teuthology.orchestra.run.smithi026.stdout:(23/131): python3-rgw-18.0.0-4313.ga02638f8.el8 377 kB/s | 107 kB 00:00 2023-06-09T04:35:35.030 INFO:teuthology.orchestra.run.smithi026.stdout:(24/131): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 516 kB/s | 94 kB 00:00 2023-06-09T04:35:35.122 INFO:teuthology.orchestra.run.smithi026.stdout:(25/131): librgw2-18.0.0-4313.ga02638f8.el8.x86 3.7 MB/s | 6.5 MB 00:01 2023-06-09T04:35:35.223 INFO:teuthology.orchestra.run.smithi026.stdout:(26/131): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 1.8 MB/s | 179 kB 00:00 2023-06-09T04:35:35.314 INFO:teuthology.orchestra.run.smithi026.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4313.g 252 kB/s | 23 kB 00:00 2023-06-09T04:35:35.423 INFO:teuthology.orchestra.run.smithi026.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4313.ga02638f 1.2 MB/s | 128 kB 00:00 2023-06-09T04:35:35.456 INFO:teuthology.orchestra.run.smithi104.stdout:(7/131): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-06-09T04:35:35.990 INFO:teuthology.orchestra.run.smithi026.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4313.ga0263 3.0 MB/s | 1.7 MB 00:00 2023-06-09T04:35:36.498 INFO:teuthology.orchestra.run.smithi104.stdout:(8/131): ceph-common-18.0.0-4313.ga02638f8.el8. 6.8 MB/s | 22 MB 00:03 2023-06-09T04:35:36.564 INFO:teuthology.orchestra.run.smithi104.stdout:(9/131): ceph-selinux-18.0.0-4313.ga02638f8.el8 366 kB/s | 24 kB 00:00 2023-06-09T04:35:37.090 INFO:teuthology.orchestra.run.smithi026.stdout:(30/131): rbd-mirror-18.0.0-4313.ga02638f8.el8. 1.7 MB/s | 3.4 MB 00:02 2023-06-09T04:35:37.173 INFO:teuthology.orchestra.run.smithi104.stdout:(10/131): ceph-osd-18.0.0-4313.ga02638f8.el8.x8 6.9 MB/s | 18 MB 00:02 2023-06-09T04:35:37.241 INFO:teuthology.orchestra.run.smithi026.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4313.ga0 1.6 MB/s | 240 kB 00:00 2023-06-09T04:35:37.248 INFO:teuthology.orchestra.run.smithi104.stdout:(11/131): cephfs-mirror-18.0.0-4313.ga02638f8.e 3.4 MB/s | 258 kB 00:00 2023-06-09T04:35:37.315 INFO:teuthology.orchestra.run.smithi104.stdout:(12/131): libcephfs-devel-18.0.0-4313.ga02638f8 465 kB/s | 31 kB 00:00 2023-06-09T04:35:37.324 INFO:teuthology.orchestra.run.smithi026.stdout:(32/131): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 569 kB/s | 47 kB 00:00 2023-06-09T04:35:37.433 INFO:teuthology.orchestra.run.smithi026.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4313.ga 134 kB/s | 15 kB 00:00 2023-06-09T04:35:37.474 INFO:teuthology.orchestra.run.smithi104.stdout:(13/131): libcephfs2-18.0.0-4313.ga02638f8.el8. 4.8 MB/s | 771 kB 00:00 2023-06-09T04:35:37.557 INFO:teuthology.orchestra.run.smithi104.stdout:(14/131): libcephsqlite-18.0.0-4313.ga02638f8.e 1.6 MB/s | 137 kB 00:00 2023-06-09T04:35:37.608 INFO:teuthology.orchestra.run.smithi026.stdout:(34/131): ceph-volume-18.0.0-4313.ga02638f8.el8 1.4 MB/s | 258 kB 00:00 2023-06-09T04:35:37.652 INFO:teuthology.orchestra.run.smithi104.stdout:(15/131): librados-devel-18.0.0-4313.ga02638f8. 1.4 MB/s | 139 kB 00:00 2023-06-09T04:35:37.709 INFO:teuthology.orchestra.run.smithi026.stdout:(35/131): cephadm-18.0.0-4313.ga02638f8.el8.noa 1.6 MB/s | 160 kB 00:00 2023-06-09T04:35:37.758 INFO:teuthology.orchestra.run.smithi104.stdout:(16/131): libradosstriper1-18.0.0-4313.ga02638f 4.4 MB/s | 473 kB 00:00 2023-06-09T04:35:37.825 INFO:teuthology.orchestra.run.smithi026.stdout:(36/131): cephfs-top-18.0.0-4313.ga02638f8.el8. 154 kB/s | 18 kB 00:00 2023-06-09T04:35:38.009 INFO:teuthology.orchestra.run.smithi026.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 3.7 MB/s | 7.4 MB 00:02 2023-06-09T04:35:38.158 INFO:teuthology.orchestra.run.smithi104.stdout:(17/131): ceph-radosgw-18.0.0-4313.ga02638f8.el 4.8 MB/s | 13 MB 00:02 2023-06-09T04:35:38.233 INFO:teuthology.orchestra.run.smithi104.stdout:(18/131): python3-ceph-argparse-18.0.0-4313.ga0 598 kB/s | 45 kB 00:00 2023-06-09T04:35:38.268 INFO:teuthology.orchestra.run.smithi026.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 228 kB/s | 59 kB 00:00 2023-06-09T04:35:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:(19/131): python3-ceph-common-18.0.0-4313.ga026 1.5 MB/s | 119 kB 00:00 2023-06-09T04:35:38.318 INFO:teuthology.orchestra.run.smithi026.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 622 kB/s | 306 kB 00:00 2023-06-09T04:35:38.368 INFO:teuthology.orchestra.run.smithi026.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 747 kB/s | 75 kB 00:00 2023-06-09T04:35:38.392 INFO:teuthology.orchestra.run.smithi104.stdout:(20/131): python3-cephfs-18.0.0-4313.ga02638f8. 2.3 MB/s | 197 kB 00:00 2023-06-09T04:35:38.427 INFO:teuthology.orchestra.run.smithi026.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-06-09T04:35:38.452 INFO:teuthology.orchestra.run.smithi026.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 522 kB/s | 44 kB 00:00 2023-06-09T04:35:38.494 INFO:teuthology.orchestra.run.smithi026.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-06-09T04:35:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:(21/131): python3-rados-18.0.0-4313.ga02638f8.e 2.9 MB/s | 370 kB 00:00 2023-06-09T04:35:38.519 INFO:teuthology.orchestra.run.smithi026.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 494 kB/s | 33 kB 00:00 2023-06-09T04:35:38.562 INFO:teuthology.orchestra.run.smithi026.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-06-09T04:35:38.628 INFO:teuthology.orchestra.run.smithi026.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-06-09T04:35:38.651 INFO:teuthology.orchestra.run.smithi104.stdout:(22/131): librgw2-18.0.0-4313.ga02638f8.el8.x86 7.3 MB/s | 6.5 MB 00:00 2023-06-09T04:35:38.676 INFO:teuthology.orchestra.run.smithi104.stdout:(23/131): python3-rbd-18.0.0-4313.ga02638f8.el8 2.2 MB/s | 365 kB 00:00 2023-06-09T04:35:38.702 INFO:teuthology.orchestra.run.smithi104.stdout:(24/131): python3-rgw-18.0.0-4313.ga02638f8.el8 2.1 MB/s | 107 kB 00:00 2023-06-09T04:35:38.704 INFO:teuthology.orchestra.run.smithi026.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-06-09T04:35:38.729 INFO:teuthology.orchestra.run.smithi026.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2023-06-09T04:35:38.735 INFO:teuthology.orchestra.run.smithi104.stdout:(25/131): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 1.6 MB/s | 94 kB 00:00 2023-06-09T04:35:38.779 INFO:teuthology.orchestra.run.smithi026.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-06-09T04:35:38.811 INFO:teuthology.orchestra.run.smithi104.stdout:(26/131): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 2.3 MB/s | 179 kB 00:00 2023-06-09T04:35:38.886 INFO:teuthology.orchestra.run.smithi104.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4313.g 307 kB/s | 23 kB 00:00 2023-06-09T04:35:38.953 INFO:teuthology.orchestra.run.smithi104.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4313.ga02638f 1.9 MB/s | 128 kB 00:00 2023-06-09T04:35:38.963 INFO:teuthology.orchestra.run.smithi026.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 75 kB/s | 18 kB 00:00 2023-06-09T04:35:39.005 INFO:teuthology.orchestra.run.smithi026.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-06-09T04:35:39.064 INFO:teuthology.orchestra.run.smithi026.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 485 kB/s | 49 kB 00:00 2023-06-09T04:35:39.089 INFO:teuthology.orchestra.run.smithi026.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 702 kB/s | 59 kB 00:00 2023-06-09T04:35:39.136 INFO:teuthology.orchestra.run.smithi104.stdout:(29/131): rbd-mirror-18.0.0-4313.ga02638f8.el8. 7.9 MB/s | 3.4 MB 00:00 2023-06-09T04:35:39.270 INFO:teuthology.orchestra.run.smithi104.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4313.ga0263 5.4 MB/s | 1.7 MB 00:00 2023-06-09T04:35:39.345 INFO:teuthology.orchestra.run.smithi104.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4313.ga0 3.1 MB/s | 240 kB 00:00 2023-06-09T04:35:39.404 INFO:teuthology.orchestra.run.smithi104.stdout:(32/131): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 813 kB/s | 47 kB 00:00 2023-06-09T04:35:39.463 INFO:teuthology.orchestra.run.smithi104.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4313.ga 249 kB/s | 15 kB 00:00 2023-06-09T04:35:39.498 INFO:teuthology.orchestra.run.smithi026.stdout:(54/131): ceph-test-18.0.0-4313.ga02638f8.el8.x 6.0 MB/s | 41 MB 00:06 2023-06-09T04:35:39.523 INFO:teuthology.orchestra.run.smithi026.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 131 kB/s | 60 kB 00:00 2023-06-09T04:35:39.548 INFO:teuthology.orchestra.run.smithi026.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 616 kB/s | 283 kB 00:00 2023-06-09T04:35:39.563 INFO:teuthology.orchestra.run.smithi104.stdout:(34/131): ceph-volume-18.0.0-4313.ga02638f8.el8 2.5 MB/s | 258 kB 00:00 2023-06-09T04:35:39.582 INFO:teuthology.orchestra.run.smithi026.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 575 kB/s | 34 kB 00:00 2023-06-09T04:35:39.630 INFO:teuthology.orchestra.run.smithi104.stdout:(35/131): cephadm-18.0.0-4313.ga02638f8.el8.noa 2.3 MB/s | 160 kB 00:00 2023-06-09T04:35:39.649 INFO:teuthology.orchestra.run.smithi026.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 922 kB/s | 61 kB 00:00 2023-06-09T04:35:39.674 INFO:teuthology.orchestra.run.smithi026.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-06-09T04:35:39.688 INFO:teuthology.orchestra.run.smithi104.stdout:(36/131): cephfs-top-18.0.0-4313.ga02638f8.el8. 309 kB/s | 18 kB 00:00 2023-06-09T04:35:39.707 INFO:teuthology.orchestra.run.smithi026.stdout:(60/131): python3-portend-2.6-1.el8.noarch.rpm 74 kB/s | 16 kB 00:00 2023-06-09T04:35:39.725 INFO:teuthology.orchestra.run.smithi026.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-06-09T04:35:39.741 INFO:teuthology.orchestra.run.smithi026.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 356 kB/s | 24 kB 00:00 2023-06-09T04:35:39.775 INFO:teuthology.orchestra.run.smithi026.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 435 kB/s | 29 kB 00:00 2023-06-09T04:35:39.800 INFO:teuthology.orchestra.run.smithi026.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-06-09T04:35:39.831 INFO:teuthology.orchestra.run.smithi104.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-06-09T04:35:39.859 INFO:teuthology.orchestra.run.smithi026.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-06-09T04:35:39.884 INFO:teuthology.orchestra.run.smithi026.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 733 kB/s | 61 kB 00:00 2023-06-09T04:35:39.926 INFO:teuthology.orchestra.run.smithi026.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-06-09T04:35:39.960 INFO:teuthology.orchestra.run.smithi026.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-06-09T04:35:39.985 INFO:teuthology.orchestra.run.smithi026.stdout:(69/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-06-09T04:35:40.011 INFO:teuthology.orchestra.run.smithi026.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-06-09T04:35:40.061 INFO:teuthology.orchestra.run.smithi026.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-06-09T04:35:40.086 INFO:teuthology.orchestra.run.smithi026.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-06-09T04:35:40.098 INFO:teuthology.orchestra.run.smithi104.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 221 kB/s | 59 kB 00:00 2023-06-09T04:35:40.111 INFO:teuthology.orchestra.run.smithi026.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 853 kB/s | 43 kB 00:00 2023-06-09T04:35:40.123 INFO:teuthology.orchestra.run.smithi104.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 705 kB/s | 306 kB 00:00 2023-06-09T04:35:40.145 INFO:teuthology.orchestra.run.smithi026.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-06-09T04:35:40.170 INFO:teuthology.orchestra.run.smithi026.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 821 kB/s | 48 kB 00:00 2023-06-09T04:35:40.221 INFO:teuthology.orchestra.run.smithi026.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-06-09T04:35:40.246 INFO:teuthology.orchestra.run.smithi026.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 568 kB/s | 43 kB 00:00 2023-06-09T04:35:40.271 INFO:teuthology.orchestra.run.smithi026.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-06-09T04:35:40.313 INFO:teuthology.orchestra.run.smithi026.stdout:(79/131): thrift-0.13.0-2.el8.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2023-06-09T04:35:40.338 INFO:teuthology.orchestra.run.smithi026.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-06-09T04:35:40.380 INFO:teuthology.orchestra.run.smithi026.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-06-09T04:35:40.405 INFO:teuthology.orchestra.run.smithi026.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 203 kB/s | 19 kB 00:00 2023-06-09T04:35:40.431 INFO:teuthology.orchestra.run.smithi026.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-06-09T04:35:40.448 INFO:teuthology.orchestra.run.smithi026.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 427 kB/s | 18 kB 00:00 2023-06-09T04:35:40.481 INFO:teuthology.orchestra.run.smithi026.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.4 MB/s | 559 kB 00:00 2023-06-09T04:35:40.490 INFO:teuthology.orchestra.run.smithi104.stdout:(40/131): ceph-test-18.0.0-4313.ga02638f8.el8.x 10 MB/s | 41 MB 00:03 2023-06-09T04:35:40.515 INFO:teuthology.orchestra.run.smithi026.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2023-06-09T04:35:40.540 INFO:teuthology.orchestra.run.smithi104.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 170 kB/s | 75 kB 00:00 2023-06-09T04:35:40.540 INFO:teuthology.orchestra.run.smithi026.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-06-09T04:35:40.574 INFO:teuthology.orchestra.run.smithi104.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2023-06-09T04:35:40.590 INFO:teuthology.orchestra.run.smithi026.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 964 kB/s | 72 kB 00:00 2023-06-09T04:35:40.616 INFO:teuthology.orchestra.run.smithi026.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-06-09T04:35:40.633 INFO:teuthology.orchestra.run.smithi026.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-06-09T04:35:40.657 INFO:teuthology.orchestra.run.smithi104.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 396 kB/s | 33 kB 00:00 2023-06-09T04:35:40.658 INFO:teuthology.orchestra.run.smithi026.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-06-09T04:35:40.683 INFO:teuthology.orchestra.run.smithi026.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-06-09T04:35:40.690 INFO:teuthology.orchestra.run.smithi104.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-06-09T04:35:40.708 INFO:teuthology.orchestra.run.smithi026.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-06-09T04:35:40.733 INFO:teuthology.orchestra.run.smithi104.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-06-09T04:35:40.766 INFO:teuthology.orchestra.run.smithi104.stdout:(46/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 158 kB/s | 44 kB 00:00 2023-06-09T04:35:40.767 INFO:teuthology.orchestra.run.smithi026.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-06-09T04:35:40.792 INFO:teuthology.orchestra.run.smithi026.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-06-09T04:35:40.808 INFO:teuthology.orchestra.run.smithi104.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-06-09T04:35:40.818 INFO:teuthology.orchestra.run.smithi026.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-06-09T04:35:40.833 INFO:teuthology.orchestra.run.smithi104.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-06-09T04:35:40.860 INFO:teuthology.orchestra.run.smithi026.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-06-09T04:35:40.876 INFO:teuthology.orchestra.run.smithi104.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-06-09T04:35:40.901 INFO:teuthology.orchestra.run.smithi104.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 605 kB/s | 81 kB 00:00 2023-06-09T04:35:40.902 INFO:teuthology.orchestra.run.smithi026.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.5 MB/s | 2.3 MB 00:00 2023-06-09T04:35:40.918 INFO:teuthology.orchestra.run.smithi104.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 209 kB/s | 18 kB 00:00 2023-06-09T04:35:40.956 INFO:teuthology.orchestra.run.smithi026.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 564 kB/s | 54 kB 00:00 2023-06-09T04:35:40.960 INFO:teuthology.orchestra.run.smithi104.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 834 kB/s | 49 kB 00:00 2023-06-09T04:35:40.985 INFO:teuthology.orchestra.run.smithi104.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 877 kB/s | 59 kB 00:00 2023-06-09T04:35:40.994 INFO:teuthology.orchestra.run.smithi026.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-06-09T04:35:41.019 INFO:teuthology.orchestra.run.smithi104.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-06-09T04:35:41.028 INFO:teuthology.orchestra.run.smithi026.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.4 MB/s | 323 kB 00:00 2023-06-09T04:35:41.053 INFO:teuthology.orchestra.run.smithi026.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-06-09T04:35:41.069 INFO:teuthology.orchestra.run.smithi104.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-06-09T04:35:41.086 INFO:teuthology.orchestra.run.smithi104.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-06-09T04:35:41.095 INFO:teuthology.orchestra.run.smithi026.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-06-09T04:35:41.128 INFO:teuthology.orchestra.run.smithi026.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-06-09T04:35:41.136 INFO:teuthology.orchestra.run.smithi104.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 503 kB/s | 34 kB 00:00 2023-06-09T04:35:41.154 INFO:teuthology.orchestra.run.smithi026.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-06-09T04:35:41.179 INFO:teuthology.orchestra.run.smithi026.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-06-09T04:35:41.211 INFO:teuthology.orchestra.run.smithi104.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-06-09T04:35:41.245 INFO:teuthology.orchestra.run.smithi104.stdout:(59/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-06-09T04:35:41.262 INFO:teuthology.orchestra.run.smithi104.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 491 kB/s | 61 kB 00:00 2023-06-09T04:35:41.279 INFO:teuthology.orchestra.run.smithi104.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-06-09T04:35:41.287 INFO:teuthology.orchestra.run.smithi026.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-06-09T04:35:41.304 INFO:teuthology.orchestra.run.smithi104.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 406 kB/s | 24 kB 00:00 2023-06-09T04:35:41.329 INFO:teuthology.orchestra.run.smithi104.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 435 kB/s | 29 kB 00:00 2023-06-09T04:35:41.355 INFO:teuthology.orchestra.run.smithi026.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 395 kB/s | 27 kB 00:00 2023-06-09T04:35:41.355 INFO:teuthology.orchestra.run.smithi104.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-06-09T04:35:41.397 INFO:teuthology.orchestra.run.smithi026.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-06-09T04:35:41.413 INFO:teuthology.orchestra.run.smithi104.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-06-09T04:35:41.430 INFO:teuthology.orchestra.run.smithi026.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-06-09T04:35:41.439 INFO:teuthology.orchestra.run.smithi104.stdout:(66/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-06-09T04:35:41.494 INFO:teuthology.orchestra.run.smithi104.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 441 kB/s | 61 kB 00:00 2023-06-09T04:35:41.522 INFO:teuthology.orchestra.run.smithi104.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 275 kB/s | 23 kB 00:00 2023-06-09T04:35:41.547 INFO:teuthology.orchestra.run.smithi026.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-06-09T04:35:41.548 INFO:teuthology.orchestra.run.smithi104.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 637 kB/s | 85 kB 00:00 2023-06-09T04:35:41.565 INFO:teuthology.orchestra.run.smithi104.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-06-09T04:35:41.597 INFO:teuthology.orchestra.run.smithi026.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-06-09T04:35:41.606 INFO:teuthology.orchestra.run.smithi104.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 801 kB/s | 47 kB 00:00 2023-06-09T04:35:41.632 INFO:teuthology.orchestra.run.smithi104.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.2 MB/s | 200 kB 00:00 2023-06-09T04:35:41.657 INFO:teuthology.orchestra.run.smithi104.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 851 kB/s | 43 kB 00:00 2023-06-09T04:35:41.682 INFO:teuthology.orchestra.run.smithi104.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-06-09T04:35:41.708 INFO:teuthology.orchestra.run.smithi104.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 955 kB/s | 48 kB 00:00 2023-06-09T04:35:41.714 INFO:teuthology.orchestra.run.smithi026.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2023-06-09T04:35:41.733 INFO:teuthology.orchestra.run.smithi104.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-09T04:35:41.748 INFO:teuthology.orchestra.run.smithi026.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2023-06-09T04:35:41.758 INFO:teuthology.orchestra.run.smithi104.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 853 kB/s | 43 kB 00:00 2023-06-09T04:35:41.773 INFO:teuthology.orchestra.run.smithi026.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-06-09T04:35:41.783 INFO:teuthology.orchestra.run.smithi104.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-06-09T04:35:41.798 INFO:teuthology.orchestra.run.smithi026.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-06-09T04:35:41.817 INFO:teuthology.orchestra.run.smithi104.stdout:(79/131): thrift-0.13.0-2.el8.x86_64.rpm 5.4 MB/s | 1.7 MB 00:00 2023-06-09T04:35:41.824 INFO:teuthology.orchestra.run.smithi026.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-06-09T04:35:41.849 INFO:teuthology.orchestra.run.smithi026.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-06-09T04:35:41.859 INFO:teuthology.orchestra.run.smithi104.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-06-09T04:35:41.893 INFO:teuthology.orchestra.run.smithi104.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-06-09T04:35:41.899 INFO:teuthology.orchestra.run.smithi026.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-06-09T04:35:41.918 INFO:teuthology.orchestra.run.smithi104.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 185 kB/s | 19 kB 00:00 2023-06-09T04:35:41.941 INFO:teuthology.orchestra.run.smithi026.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-06-09T04:35:41.944 INFO:teuthology.orchestra.run.smithi104.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.9 MB/s | 155 kB 00:00 2023-06-09T04:35:41.969 INFO:teuthology.orchestra.run.smithi104.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-06-09T04:35:42.002 INFO:teuthology.orchestra.run.smithi104.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-06-09T04:35:42.044 INFO:teuthology.orchestra.run.smithi104.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-06-09T04:35:42.069 INFO:teuthology.orchestra.run.smithi104.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-06-09T04:35:42.095 INFO:teuthology.orchestra.run.smithi104.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-06-09T04:35:42.120 INFO:teuthology.orchestra.run.smithi104.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-06-09T04:35:42.125 INFO:teuthology.orchestra.run.smithi026.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 10 MB/s | 14 MB 00:01 2023-06-09T04:35:42.145 INFO:teuthology.orchestra.run.smithi104.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-06-09T04:35:42.167 INFO:teuthology.orchestra.run.smithi026.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-06-09T04:35:42.171 INFO:teuthology.orchestra.run.smithi104.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-06-09T04:35:42.196 INFO:teuthology.orchestra.run.smithi104.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-06-09T04:35:42.208 INFO:teuthology.orchestra.run.smithi026.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-06-09T04:35:42.221 INFO:teuthology.orchestra.run.smithi104.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 771 kB/s | 39 kB 00:00 2023-06-09T04:35:42.255 INFO:teuthology.orchestra.run.smithi104.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-06-09T04:35:42.280 INFO:teuthology.orchestra.run.smithi104.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-06-09T04:35:42.292 INFO:teuthology.orchestra.run.smithi026.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-06-09T04:35:42.297 INFO:teuthology.orchestra.run.smithi104.stdout:(96/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-06-09T04:35:42.355 INFO:teuthology.orchestra.run.smithi104.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.6 MB/s | 2.3 MB 00:00 2023-06-09T04:35:42.381 INFO:teuthology.orchestra.run.smithi104.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-06-09T04:35:42.384 INFO:teuthology.orchestra.run.smithi026.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-06-09T04:35:42.406 INFO:teuthology.orchestra.run.smithi104.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-06-09T04:35:42.409 INFO:teuthology.orchestra.run.smithi026.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-06-09T04:35:42.465 INFO:teuthology.orchestra.run.smithi104.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-06-09T04:35:42.498 INFO:teuthology.orchestra.run.smithi104.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-06-09T04:35:42.501 INFO:teuthology.orchestra.run.smithi026.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-06-09T04:35:42.532 INFO:teuthology.orchestra.run.smithi104.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 581 kB/s | 39 kB 00:00 2023-06-09T04:35:42.582 INFO:teuthology.orchestra.run.smithi104.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.0 MB/s | 688 kB 00:00 2023-06-09T04:35:42.594 INFO:teuthology.orchestra.run.smithi026.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-06-09T04:35:42.616 INFO:teuthology.orchestra.run.smithi104.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-06-09T04:35:42.641 INFO:teuthology.orchestra.run.smithi104.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-06-09T04:35:42.644 INFO:teuthology.orchestra.run.smithi026.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-06-09T04:35:42.666 INFO:teuthology.orchestra.run.smithi104.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-06-09T04:35:42.700 INFO:teuthology.orchestra.run.smithi104.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-06-09T04:35:42.733 INFO:teuthology.orchestra.run.smithi104.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 799 kB/s | 27 kB 00:00 2023-06-09T04:35:42.775 INFO:teuthology.orchestra.run.smithi104.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-06-09T04:35:42.809 INFO:teuthology.orchestra.run.smithi104.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-06-09T04:35:42.901 INFO:teuthology.orchestra.run.smithi104.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-06-09T04:35:42.943 INFO:teuthology.orchestra.run.smithi104.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-06-09T04:35:42.977 INFO:teuthology.orchestra.run.smithi104.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 6.6 MB/s | 225 kB 00:00 2023-06-09T04:35:42.978 INFO:teuthology.orchestra.run.smithi026.stdout:(130/131): librados2-18.0.0-4313.ga02638f8.el8. 6.4 MB/s | 3.7 MB 00:00 2023-06-09T04:35:43.035 INFO:teuthology.orchestra.run.smithi104.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-06-09T04:35:43.061 INFO:teuthology.orchestra.run.smithi104.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-06-09T04:35:43.086 INFO:teuthology.orchestra.run.smithi104.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-06-09T04:35:43.111 INFO:teuthology.orchestra.run.smithi104.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-06-09T04:35:43.136 INFO:teuthology.orchestra.run.smithi104.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-06-09T04:35:43.170 INFO:teuthology.orchestra.run.smithi104.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-06-09T04:35:43.311 INFO:teuthology.orchestra.run.smithi026.stdout:(131/131): librbd1-18.0.0-4313.ga02638f8.el8.x8 4.4 MB/s | 3.6 MB 00:00 2023-06-09T04:35:43.312 INFO:teuthology.orchestra.run.smithi104.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-06-09T04:35:43.315 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-06-09T04:35:43.315 INFO:teuthology.orchestra.run.smithi026.stdout:Total 14 MB/s | 197 MB 00:14 2023-06-09T04:35:43.337 INFO:teuthology.orchestra.run.smithi104.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-06-09T04:35:43.404 INFO:teuthology.orchestra.run.smithi104.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-06-09T04:35:43.446 INFO:teuthology.orchestra.run.smithi104.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-06-09T04:35:43.530 INFO:teuthology.orchestra.run.smithi104.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-06-09T04:35:43.597 INFO:teuthology.orchestra.run.smithi104.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-06-09T04:35:43.630 INFO:teuthology.orchestra.run.smithi104.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-06-09T04:35:43.680 INFO:teuthology.orchestra.run.smithi104.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-06-09T04:35:43.756 INFO:teuthology.orchestra.run.smithi104.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-06-09T04:35:43.806 INFO:teuthology.orchestra.run.smithi104.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-06-09T04:35:44.073 INFO:teuthology.orchestra.run.smithi104.stdout:(130/131): librbd1-18.0.0-4313.ga02638f8.el8.x8 9.1 MB/s | 3.6 MB 00:00 2023-06-09T04:35:44.165 INFO:teuthology.orchestra.run.smithi104.stdout:(131/131): librados2-18.0.0-4313.ga02638f8.el8. 6.8 MB/s | 3.7 MB 00:00 2023-06-09T04:35:44.169 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2023-06-09T04:35:44.169 INFO:teuthology.orchestra.run.smithi104.stdout:Total 18 MB/s | 197 MB 00:10 2023-06-09T04:35:44.181 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-06-09T04:35:44.314 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-06-09T04:35:44.314 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-06-09T04:35:45.003 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2023-06-09T04:35:45.124 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2023-06-09T04:35:45.124 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2023-06-09T04:35:45.470 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-06-09T04:35:45.475 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-06-09T04:35:46.204 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2023-06-09T04:35:46.208 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2023-06-09T04:35:51.050 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2023-06-09T04:35:51.068 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-06-09T04:35:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-09T04:35:51.283 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-09T04:35:51.446 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-09T04:35:51.518 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-09T04:35:51.624 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-09T04:35:51.693 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-09T04:35:51.746 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-09T04:35:51.849 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-09T04:35:51.957 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-09T04:35:52.190 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-09T04:35:52.384 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-09T04:35:52.615 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 5/134 2023-06-09T04:35:52.616 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-09T04:35:52.835 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 5/134 2023-06-09T04:35:53.026 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 5/134 2023-06-09T04:35:53.231 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:35:53.258 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 5/134 2023-06-09T04:35:53.364 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:35:53.476 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:35:53.564 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:35:53.607 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:35:53.652 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:35:53.828 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:35:53.851 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:35:53.956 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:35:54.073 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-06-09T04:35:54.148 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:35:54.319 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-09T04:35:54.355 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-06-09T04:35:54.509 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-09T04:35:54.649 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-09T04:35:54.899 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-09T04:35:54.908 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-09T04:35:55.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-09T04:35:55.314 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-09T04:35:55.339 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:35:55.444 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:35:55.556 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-09T04:35:55.623 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:35:55.767 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:35:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:35:55.878 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:35:55.976 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-06-09T04:35:56.093 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:35:56.170 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:35:56.432 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-06-09T04:35:56.448 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-06-09T04:35:56.556 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-09T04:35:56.617 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-06-09T04:35:56.678 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-09T04:35:56.809 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-06-09T04:35:56.814 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-09T04:35:56.942 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-09T04:35:57.077 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-09T04:35:57.450 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-09T04:35:57.551 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-09T04:35:57.647 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-09T04:35:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-09T04:35:58.241 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-09T04:35:58.405 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-06-09T04:35:58.518 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-09T04:35:59.108 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-06-09T04:35:59.185 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-09T04:35:59.369 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-06-09T04:35:59.392 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-06-09T04:35:59.553 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-06-09T04:35:59.823 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-09T04:36:00.003 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 26/134 2023-06-09T04:36:00.133 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 27/134 2023-06-09T04:36:00.155 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-06-09T04:36:00.360 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 28/134 2023-06-09T04:36:00.433 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-06-09T04:36:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-09T04:36:00.670 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-06-09T04:36:00.915 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-09T04:36:01.082 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 26/134 2023-06-09T04:36:01.254 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 27/134 2023-06-09T04:36:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 28/134 2023-06-09T04:36:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-09T04:36:02.318 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-09T04:36:03.343 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-06-09T04:36:03.599 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-09T04:36:03.660 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-06-09T04:36:03.923 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-06-09T04:36:04.136 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-06-09T04:36:04.340 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-09T04:36:04.531 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-09T04:36:04.689 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-06-09T04:36:04.751 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 36/134 2023-06-09T04:36:04.902 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 37/134 2023-06-09T04:36:05.052 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-06-09T04:36:05.055 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-06-09T04:36:05.204 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-06-09T04:36:05.357 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-06-09T04:36:05.404 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-06-09T04:36:05.458 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-06-09T04:36:05.557 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-06-09T04:36:05.690 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-06-09T04:36:05.890 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-06-09T04:36:05.933 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-09T04:36:06.062 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-09T04:36:06.128 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-09T04:36:06.179 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-09T04:36:06.356 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 36/134 2023-06-09T04:36:06.357 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-06-09T04:36:06.549 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 37/134 2023-06-09T04:36:06.574 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-06-09T04:36:06.700 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-06-09T04:36:06.746 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-06-09T04:36:06.886 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-06-09T04:36:06.930 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-06-09T04:36:07.058 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-06-09T04:36:07.119 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-06-09T04:36:07.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-06-09T04:36:07.281 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-06-09T04:36:07.377 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-06-09T04:36:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-06-09T04:36:07.629 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-06-09T04:36:07.698 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-06-09T04:36:07.782 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-09T04:36:07.864 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-09T04:36:08.061 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-06-09T04:36:08.109 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-06-09T04:36:08.286 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-06-09T04:36:08.313 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-06-09T04:36:08.478 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-06-09T04:36:08.540 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-06-09T04:36:08.644 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-06-09T04:36:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-06-09T04:36:08.843 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-06-09T04:36:08.988 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-06-09T04:36:09.033 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-06-09T04:36:09.218 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-06-09T04:36:09.344 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-06-09T04:36:09.425 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-06-09T04:36:09.594 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-06-09T04:36:09.791 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-06-09T04:36:09.802 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-06-09T04:36:10.033 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-06-09T04:36:10.208 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-06-09T04:36:10.219 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-06-09T04:36:10.381 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-06-09T04:36:10.437 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-06-09T04:36:10.688 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-06-09T04:36:10.723 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-06-09T04:36:10.941 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-06-09T04:36:10.999 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-06-09T04:36:11.174 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-06-09T04:36:11.325 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-06-09T04:36:11.462 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-06-09T04:36:11.557 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-06-09T04:36:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-09T04:36:11.798 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-06-09T04:36:11.813 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-09T04:36:12.010 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-06-09T04:36:12.070 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-09T04:36:12.207 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-06-09T04:36:12.325 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-09T04:36:12.396 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-06-09T04:36:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-09T04:36:12.637 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-09T04:36:12.749 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-06-09T04:36:12.843 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-09T04:36:13.021 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-09T04:36:13.073 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-06-09T04:36:13.194 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-09T04:36:13.332 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-06-09T04:36:13.371 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-09T04:36:13.507 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-09T04:36:13.525 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-06-09T04:36:13.719 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-09T04:36:13.731 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-09T04:36:13.911 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-09T04:36:13.912 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-09T04:36:14.098 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-09T04:36:14.198 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-09T04:36:14.375 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-09T04:36:14.464 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-09T04:36:14.600 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-09T04:36:14.636 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-09T04:36:14.773 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-09T04:36:14.827 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-09T04:36:14.978 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-09T04:36:15.019 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-09T04:36:15.238 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-09T04:36:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-09T04:36:15.618 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-09T04:36:15.763 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-09T04:36:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-09T04:36:16.087 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-09T04:36:16.270 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-09T04:36:16.338 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-09T04:36:16.471 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-09T04:36:16.585 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-09T04:36:16.760 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-09T04:36:16.878 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-09T04:36:16.989 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-09T04:36:17.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-09T04:36:17.198 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-09T04:36:17.418 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-09T04:36:17.460 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-09T04:36:18.204 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-09T04:36:18.384 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:36:18.455 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:36:18.587 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-09T04:36:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 93/134 2023-06-09T04:36:18.829 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-09T04:36:19.082 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-09T04:36:19.417 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-09T04:36:19.730 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-09T04:36:19.923 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-09T04:36:20.734 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-09T04:36:20.897 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:36:20.960 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:36:21.155 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 93/134 2023-06-09T04:36:22.177 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:36:22.659 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:36:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:36:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:36:23.583 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:36:23.725 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:36:24.967 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:36:25.205 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:36:25.834 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:36:26.125 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:36:26.215 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:36:26.413 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:36:42.249 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:36:42.249 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2023-06-09T04:36:42.249 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /dev 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /run 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2023-06-09T04:36:42.250 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /dev 2023-06-09T04:36:42.251 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:36:42.579 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:36:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:36:44.326 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:36:44.544 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:36:44.696 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:36:45.145 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:36:45.337 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:36:45.354 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:36:46.020 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:36:46.020 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2023-06-09T04:36:46.021 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2023-06-09T04:36:46.022 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-06-09T04:36:46.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:36:46.360 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:36:47.036 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:36:47.228 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:36:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 102/134 2023-06-09T04:36:47.525 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 103/134 2023-06-09T04:36:47.719 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:36:47.932 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:36:48.041 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:36:48.204 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:36:48.250 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:36:48.436 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:36:48.576 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:36:49.056 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:36:49.207 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:36:49.234 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:36:49.252 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:36:49.369 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:36:49.459 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:36:49.819 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 107/134 2023-06-09T04:36:50.075 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:36:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:36:50.278 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:36:50.289 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:36:51.184 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:36:51.523 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:36:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 110/134 2023-06-09T04:36:51.665 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 102/134 2023-06-09T04:36:51.733 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:36:51.766 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:36:51.832 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 103/134 2023-06-09T04:36:51.969 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:36:52.010 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:36:52.033 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:36:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:36:52.256 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:36:52.478 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:36:52.512 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:36:52.685 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:36:53.504 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:36:53.650 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:36:53.745 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:36:54.133 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 107/134 2023-06-09T04:36:54.387 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:36:54.423 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:36:54.592 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:36:54.603 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:36:55.923 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 110/134 2023-06-09T04:36:56.198 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:36:56.233 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:36:56.367 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:36:56.410 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:36:56.583 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:36:56.598 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:36:56.951 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:36:57.091 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:36:57.481 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 115/134 2023-06-09T04:36:57.807 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-06-09T04:36:58.017 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 117/134 2023-06-09T04:36:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-06-09T04:36:58.425 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-06-09T04:36:58.615 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-06-09T04:36:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-06-09T04:36:59.021 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 121/134 2023-06-09T04:36:59.160 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-09T04:37:01.294 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:37:01.330 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:37:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:37:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:37:01.778 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 124/134 2023-06-09T04:37:02.049 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 125/134 2023-06-09T04:37:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 115/134 2023-06-09T04:37:02.343 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 126/134 2023-06-09T04:37:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-06-09T04:37:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-09T04:37:02.809 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 117/134 2023-06-09T04:37:02.899 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-06-09T04:37:02.982 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-06-09T04:37:03.050 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-06-09T04:37:03.200 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-06-09T04:37:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-06-09T04:37:03.231 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-06-09T04:37:03.375 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-09T04:37:03.382 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-09T04:37:03.441 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-06-09T04:37:03.526 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-06-09T04:37:03.527 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:37:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-06-09T04:37:03.753 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:37:03.753 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:37:03.911 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 121/134 2023-06-09T04:37:03.981 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:37:04.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-09T04:37:04.190 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:37:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:37:04.477 INFO:teuthology.orchestra.run.smithi104.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-09T04:37:04.477 INFO:teuthology.orchestra.run.smithi104.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-09T04:37:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/134 2023-06-09T04:37:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/134 2023-06-09T04:37:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-09T04:37:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/134 2023-06-09T04:37:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/134 2023-06-09T04:37:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/134 2023-06-09T04:37:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/134 2023-06-09T04:37:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/134 2023-06-09T04:37:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/134 2023-06-09T04:37:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/134 2023-06-09T04:37:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/134 2023-06-09T04:37:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/134 2023-06-09T04:37:04.704 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/134 2023-06-09T04:37:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/134 2023-06-09T04:37:04.706 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-09T04:37:04.707 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-09T04:37:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-09T04:37:04.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-09T04:37:04.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-09T04:37:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-09T04:37:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-09T04:37:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-09T04:37:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-09T04:37:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-06-09T04:37:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-06-09T04:37:04.712 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-06-09T04:37:04.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-06-09T04:37:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-06-09T04:37:04.715 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-06-09T04:37:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-06-09T04:37:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-06-09T04:37:04.718 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-06-09T04:37:04.719 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/134 2023-06-09T04:37:04.720 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-09T04:37:04.720 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/134 2023-06-09T04:37:04.720 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:37:04.720 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-09T04:37:06.479 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:37:06.706 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:37:06.725 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:37:06.980 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 124/134 2023-06-09T04:37:07.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:37:07.211 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:46 ago on Fri 09 Jun 2023 04:35:21 AM UTC. 2023-06-09T04:37:07.223 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 125/134 2023-06-09T04:37:07.508 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 126/134 2023-06-09T04:37:07.859 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-09T04:37:08.047 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-06-09T04:37:08.133 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-06-09T04:37:08.373 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-06-09T04:37:08.386 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-06-09T04:37:08.531 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-09T04:37:08.540 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-09T04:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-06-09T04:37:08.683 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:37:08.893 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:37:08.893 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:37:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:37:09.339 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:37:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:37:09.679 INFO:teuthology.orchestra.run.smithi026.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-09T04:37:09.679 INFO:teuthology.orchestra.run.smithi026.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-09T04:37:09.679 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:09.839 INFO:teuthology.orchestra.run.smithi104.stdout:Installed products updated. 2023-06-09T04:37:09.916 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/134 2023-06-09T04:37:09.916 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/134 2023-06-09T04:37:09.916 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/134 2023-06-09T04:37:09.916 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/134 2023-06-09T04:37:09.917 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/134 2023-06-09T04:37:09.918 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/134 2023-06-09T04:37:09.919 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/134 2023-06-09T04:37:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-09T04:37:09.921 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-09T04:37:09.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-09T04:37:09.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-09T04:37:09.924 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-06-09T04:37:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-06-09T04:37:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-06-09T04:37:09.927 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-06-09T04:37:09.928 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-06-09T04:37:09.929 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-06-09T04:37:09.930 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-06-09T04:37:09.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-06-09T04:37:09.932 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-06-09T04:37:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/134 2023-06-09T04:37:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-09T04:37:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/134 2023-06-09T04:37:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:37:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-09T04:37:10.072 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:10.072 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2023-06-09T04:37:10.072 INFO:teuthology.orchestra.run.smithi104.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-09T04:37:10.072 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.073 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.073 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2023-06-09T04:37:10.073 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-09T04:37:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.1-7.el8.noarch 2023-06-09T04:37:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.0.4-10.el8.x86_64 2023-06-09T04:37:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.075 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.076 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.076 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.076 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.076 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.076 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.076 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:10.077 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.1-9.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: jq-1.6-3.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-09T04:37:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-09T04:37:10.079 INFO:teuthology.orchestra.run.smithi104.stdout: libpq-13.5-1.el8.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.080 INFO:teuthology.orchestra.run.smithi104.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-09T04:37:10.081 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-09T04:37:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-09T04:37:10.083 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-09T04:37:10.084 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-09T04:37:10.085 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-09T04:37:10.086 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-09T04:37:10.087 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-09T04:37:10.087 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-09T04:37:10.087 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-09T04:37:10.087 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-2.6-1.el8.noarch 2023-06-09T04:37:10.087 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-09T04:37:10.088 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-09T04:37:10.088 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-09T04:37:10.088 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-09T04:37:10.088 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-09T04:37:10.088 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-09T04:37:10.088 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-09T04:37:10.089 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-09T04:37:10.090 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-09T04:37:10.091 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-09T04:37:10.092 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-09T04:37:10.092 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-09T04:37:10.092 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-09T04:37:10.092 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-09T04:37:10.093 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:10.093 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2023-06-09T04:37:10.285 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:12.530 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:37:12.530 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:56 ago on Fri 09 Jun 2023 04:35:16 AM UTC. 2023-06-09T04:37:15.186 INFO:teuthology.orchestra.run.smithi026.stdout:Installed products updated. 2023-06-09T04:37:15.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:15.434 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-06-09T04:37:15.434 INFO:teuthology.orchestra.run.smithi026.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-09T04:37:15.434 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.434 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.434 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-06-09T04:37:15.434 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.1-7.el8.noarch 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.0.4-10.el8.x86_64 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.435 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.436 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.1-9.el8.x86_64 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: jq-1.6-3.el8.x86_64 2023-06-09T04:37:15.438 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-09T04:37:15.439 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: libpq-13.5-1.el8.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-09T04:37:15.440 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-09T04:37:15.441 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:37:15.442 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-09T04:37:15.443 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-09T04:37:15.444 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-09T04:37:15.445 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-09T04:37:15.446 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-09T04:37:15.447 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-09T04:37:15.448 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-09T04:37:15.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-09T04:37:15.450 INFO:teuthology.orchestra.run.smithi026.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-09T04:37:15.451 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-09T04:37:15.451 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-09T04:37:15.451 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-09T04:37:15.451 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:15.451 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-06-09T04:37:15.659 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:15.659 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:37:15.985 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-09T04:37:16.009 INFO:teuthology.orchestra.run.smithi026.stdout:18.0.0-4313.ga02638f8.el8 2023-06-09T04:37:16.009 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-09T04:37:16.010 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-09T04:37:16.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:37:16.148 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-09T04:37:16.170 INFO:teuthology.orchestra.run.smithi104.stdout:18.0.0-4313.ga02638f8.el8 2023-06-09T04:37:16.170 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-09T04:37:16.170 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-09T04:37:16.171 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-09T04:37:16.171 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:16.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:37:16.213 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:16.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:37:16.254 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-09T04:37:16.254 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:16.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:37:16.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:37:16.350 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:16.350 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:37:16.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:37:16.441 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-09T04:37:16.441 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:16.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:37:16.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:37:16.535 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:16.535 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:37:16.561 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:37:16.627 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-09T04:37:16.628 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:16.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:37:16.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:37:16.721 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:16.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:37:16.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:37:16.813 INFO:teuthology.run_tasks:Running task ceph... 2023-06-09T04:37:16.877 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-09T04:37:16.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2023-06-09T04:37:16.879 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2023-06-09T04:37:16.905 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-09T04:37:16.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:37:16.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:37:16.973 INFO:tasks.ceph:Creating extra log directories... 2023-06-09T04:37:16.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:37:17.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:37:17.047 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-09T04:37:17.047 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-09T04:37:17.047 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-09T04:37:17.047 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:17.048 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:37:17.097 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:17.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:17.259 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:17.259 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:37:17.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:17.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:17.539 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-09T04:37:17.539 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-09T04:37:17.540 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299734', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7299734', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi104.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-09_04:16:27', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-09T04:37:17.540 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:37:17.542 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:37:17.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:37:17.599 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:37:17.658 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:17.658 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:37:17.680 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:37:17.680 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-06-09T04:37:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:37:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:17.737 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 373146 Links: 1 2023-06-09T04:37:17.737 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:17.737 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:17.738 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-06-09 04:37:09.592392499 +0000 2023-06-09T04:37:17.738 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-06-09 04:30:22.921224751 +0000 2023-06-09T04:37:17.738 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-06-09 04:30:22.921224751 +0000 2023-06-09T04:37:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-06-09T04:37:17.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:37:17.802 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-06-09T04:37:17.803 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-06-09T04:37:17.803 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.7871e-05 s, 5.2 MB/s 2023-06-09T04:37:17.804 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:37:17.861 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-06-09T04:37:17.919 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 370594 Links: 1 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-06-09 04:37:09.592392499 +0000 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-06-09 04:30:23.461216689 +0000 2023-06-09T04:37:17.920 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-06-09 04:30:23.461216689 +0000 2023-06-09T04:37:17.921 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-06-09T04:37:17.921 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:37:17.985 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-06-09T04:37:17.986 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-06-09T04:37:17.986 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.4253e-05 s, 5.4 MB/s 2023-06-09T04:37:17.987 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:37:18.044 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-06-09T04:37:18.101 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:37:18.101 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:18.101 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 368324 Links: 1 2023-06-09T04:37:18.101 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:18.101 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:18.101 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-06-09 04:37:09.592392499 +0000 2023-06-09T04:37:18.102 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-06-09 04:30:23.992208763 +0000 2023-06-09T04:37:18.102 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-06-09 04:30:23.992208763 +0000 2023-06-09T04:37:18.102 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-06-09T04:37:18.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:37:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-06-09T04:37:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-06-09T04:37:18.170 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000103177 s, 5.0 MB/s 2023-06-09T04:37:18.171 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:37:18.228 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 368437 Links: 1 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-06-09 04:37:09.592392499 +0000 2023-06-09T04:37:18.287 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-06-09 04:30:24.518200911 +0000 2023-06-09T04:37:18.288 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-06-09 04:30:24.518200911 +0000 2023-06-09T04:37:18.288 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-06-09T04:37:18.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:37:18.354 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.4121e-05 s, 5.4 MB/s 2023-06-09T04:37:18.356 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:37:18.413 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:18.414 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:18.414 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:37:18.430 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:37:18.430 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2023-06-09T04:37:18.486 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:37:18.486 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:18.486 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 376922 Links: 1 2023-06-09T04:37:18.487 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:18.487 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:18.487 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-06-09 04:37:04.396880993 +0000 2023-06-09T04:37:18.487 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-06-09 04:34:24.521731265 +0000 2023-06-09T04:37:18.487 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-06-09 04:34:24.521731265 +0000 2023-06-09T04:37:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2023-06-09T04:37:18.488 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:37:18.552 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-06-09T04:37:18.553 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-06-09T04:37:18.553 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000228371 s, 2.2 MB/s 2023-06-09T04:37:18.554 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:37:18.612 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2023-06-09T04:37:18.670 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:37:18.670 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:18.670 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 377037 Links: 1 2023-06-09T04:37:18.671 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:18.671 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:18.671 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-06-09 04:37:04.396880993 +0000 2023-06-09T04:37:18.671 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-06-09 04:34:25.030725251 +0000 2023-06-09T04:37:18.671 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-06-09 04:34:25.030725251 +0000 2023-06-09T04:37:18.671 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2023-06-09T04:37:18.672 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000237805 s, 2.2 MB/s 2023-06-09T04:37:18.736 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:37:18.793 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2023-06-09T04:37:18.849 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:37:18.849 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:18.849 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 375415 Links: 1 2023-06-09T04:37:18.849 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:18.850 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:18.850 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-06-09 04:37:04.396880993 +0000 2023-06-09T04:37:18.850 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-06-09 04:34:25.531719332 +0000 2023-06-09T04:37:18.850 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-06-09 04:34:25.531719332 +0000 2023-06-09T04:37:18.850 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2023-06-09T04:37:18.850 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:37:18.914 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-06-09T04:37:18.915 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-06-09T04:37:18.915 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000213549 s, 2.4 MB/s 2023-06-09T04:37:18.916 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:37:18.974 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2023-06-09T04:37:19.030 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:37:19.030 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:19.031 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 378148 Links: 1 2023-06-09T04:37:19.031 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:19.031 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:37:19.031 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2023-06-09 04:37:04.396880993 +0000 2023-06-09T04:37:19.031 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2023-06-09 04:34:26.064713036 +0000 2023-06-09T04:37:19.031 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2023-06-09 04:34:26.064713036 +0000 2023-06-09T04:37:19.032 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2023-06-09T04:37:19.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:37:19.094 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2023-06-09T04:37:19.095 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2023-06-09T04:37:19.095 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00019475 s, 2.6 MB/s 2023-06-09T04:37:19.096 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:37:19.153 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:19.153 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:37:19.154 INFO:tasks.ceph:Generating config... 2023-06-09T04:37:19.155 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-09T04:37:19.155 INFO:tasks.ceph:[client] debug client = 20 2023-06-09T04:37:19.155 INFO:tasks.ceph:[client] debug ms = 1 2023-06-09T04:37:19.156 INFO:tasks.ceph:[client] pid file = 2023-06-09T04:37:19.156 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-09T04:37:19.156 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-09T04:37:19.156 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-09T04:37:19.156 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-09T04:37:19.157 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-09T04:37:19.157 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-09T04:37:19.157 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-09T04:37:19.157 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-09T04:37:19.157 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-09T04:37:19.158 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-09T04:37:19.158 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-09T04:37:19.158 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-09T04:37:19.158 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-09T04:37:19.158 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-09T04:37:19.158 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-09T04:37:19.159 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-09T04:37:19.159 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-09T04:37:19.159 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-09T04:37:19.159 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-09T04:37:19.159 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-09T04:37:19.160 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-09T04:37:19.160 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-09T04:37:19.160 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-09T04:37:19.160 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-09T04:37:19.160 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-09T04:37:19.161 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-09T04:37:19.161 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-09T04:37:19.161 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-09T04:37:19.161 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-09T04:37:19.161 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-09T04:37:19.161 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-09T04:37:19.162 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-09T04:37:19.162 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-09T04:37:19.162 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-09T04:37:19.162 INFO:tasks.ceph:Setting up mon.a... 2023-06-09T04:37:19.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:19.212 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2023-06-09T04:37:19.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-09T04:37:19.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:37:19.289 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.104'), ('mon.c', '[v2:172.21.15.104:3301,v1:172.21.15.104:6790]')] 2023-06-09T04:37:19.290 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-09T04:37:19.291 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:19.291 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:37:19.347 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.104 --addv c '[v2:172.21.15.104:3301,v1:172.21.15.104:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid d8ea66dc-572e-4c93-a618-c44f62bf95ff 2023-06-09T04:37:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = pacific 2023-06-09T04:37:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2023-06-09T04:37:19.435 INFO:teuthology.orchestra.run.smithi026.stdout:fsid d8ea66dc-572e-4c93-a618-c44f62bf95ff 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2023-06-09T04:37:19.435447+0000 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-06-09T04:37:19.435447+0000 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 16 (pacific) 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2023-06-09T04:37:19.436 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2023-06-09T04:37:19.437 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-09T04:37:19.438 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:37:19.454 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d8ea66dc-572e-4c93-a618-c44f62bf95ff... 2023-06-09T04:37:19.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:37:19.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:37:19.541 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2023-06-09T04:37:19.541 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2023-06-09T04:37:19.541 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2023-06-09T04:37:19.542 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.543 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2023-06-09T04:37:19.544 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2023-06-09T04:37:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2023-06-09T04:37:19.546 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.26,172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790]" 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = d8ea66dc-572e-4c93-a618-c44f62bf95ff 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.547 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2023-06-09T04:37:19.548 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.549 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2023-06-09T04:37:19.550 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2023-06-09T04:37:19.551 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2023-06-09T04:37:19.552 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:19.553 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2023-06-09T04:37:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:37:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:37:19.556 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: mon op complaint time = 120 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2023-06-09T04:37:19.557 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: client mount timeout = 600 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2023-06-09T04:37:19.558 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout:[mds] 2023-06-09T04:37:19.559 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds = 20 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds balancer = 20 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug frag = True 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug scatterstat = True 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: mds op complaint time = 180 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: mds verify scatter = True 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2023-06-09T04:37:19.560 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2023-06-09T04:37:19.561 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2023-06-09T04:37:19.562 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-06-09T04:37:19.562 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2023-06-09T04:37:19.562 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:37:19.562 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2023-06-09T04:37:19.562 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.562 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.563 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:37:19.564 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2023-06-09T04:37:19.565 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.566 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2023-06-09T04:37:19.567 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790]" 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = d8ea66dc-572e-4c93-a618-c44f62bf95ff 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2023-06-09T04:37:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2023-06-09T04:37:19.569 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.570 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2023-06-09T04:37:19.571 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2023-06-09T04:37:19.572 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.573 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2023-06-09T04:37:19.574 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2023-06-09T04:37:19.575 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:37:19.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.577 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:37:19.578 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2023-06-09T04:37:19.578 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:19.578 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2023-06-09T04:37:19.578 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2023-06-09T04:37:19.578 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2023-06-09T04:37:19.578 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2023-06-09T04:37:19.579 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:37:19.579 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:37:19.579 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2023-06-09T04:37:19.579 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-06-09T04:37:19.580 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-06-09T04:37:19.580 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = "" 2023-06-09T04:37:19.580 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-06-09T04:37:19.580 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-06-09T04:37:19.580 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2023-06-09T04:37:19.580 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2023-06-09T04:37:19.581 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2023-06-09T04:37:19.581 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-06-09T04:37:19.581 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-06-09T04:37:19.581 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-06-09T04:37:19.581 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-06-09T04:37:19.581 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2023-06-09T04:37:19.582 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2023-06-09T04:37:19.582 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2023-06-09T04:37:19.582 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-06-09T04:37:19.582 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2023-06-09T04:37:19.582 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2023-06-09T04:37:19.582 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2023-06-09T04:37:19.583 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2023-06-09T04:37:19.583 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-06-09T04:37:19.583 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-06-09T04:37:19.583 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-06-09T04:37:19.583 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-09T04:37:19.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-09T04:37:19.662 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-09T04:37:19.662 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:19.662 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-09T04:37:19.679 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:19.679 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-09T04:37:19.735 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:37:19.736 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:19.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:37:19.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:37:19.814 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:19.814 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:19.871 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:37:19.871 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:19.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:37:19.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:37:19.908 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:19.908 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:19.964 INFO:tasks.ceph:Setting up mon nodes... 2023-06-09T04:37:19.965 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-09T04:37:19.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:37:20.022 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:37:20.024 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:37:20.084 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:37:20.087 INFO:tasks.ceph:Setting up mds nodes... 2023-06-09T04:37:20.088 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:37:20.144 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:37:20.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-09T04:37:20.174 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:37:20.271 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:37:20.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-09T04:37:20.300 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:37:20.355 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:37:20.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-09T04:37:20.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:37:20.475 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:37:20.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-09T04:37:20.503 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-09T04:37:20.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-09T04:37:20.551 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-09T04:37:20.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-09T04:37:20.610 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-09T04:37:20.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-09T04:37:20.667 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-09T04:37:20.680 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-09T04:37:20.762 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-09T04:37:20.776 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-09T04:37:20.777 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:37:20.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:20.804 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:20.804 INFO:tasks.ceph:role: osd.0 2023-06-09T04:37:20.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:37:20.805 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:37:20.871 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:20.872 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:20.873 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:20.894 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-06-09T04:37:20.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-06-09T04:37:20.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:20.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:21.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:21.118 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:21.118 INFO:tasks.ceph:role: osd.1 2023-06-09T04:37:21.118 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:37:21.119 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:37:21.184 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:21.184 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:21.184 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:21.185 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:21.207 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-06-09T04:37:21.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-06-09T04:37:21.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:21.288 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:21.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:21.427 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:21.428 INFO:tasks.ceph:role: osd.2 2023-06-09T04:37:21.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:37:21.428 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:37:21.495 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:21.495 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:21.495 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:21.495 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:21.495 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:21.496 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:21.496 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:21.496 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:21.496 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:21.496 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:21.518 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-06-09T04:37:21.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-06-09T04:37:21.520 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:21.600 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:21.670 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:21.736 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:21.736 INFO:tasks.ceph:role: osd.3 2023-06-09T04:37:21.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:37:21.737 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:37:21.802 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:21.802 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:21.802 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:21.802 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:21.802 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:21.803 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:21.803 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:21.803 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:21.803 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:21.803 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:21.827 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-06-09T04:37:21.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-06-09T04:37:21.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:21.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:21.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:22.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:22.205+0000 7f86042b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-09T04:37:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:22.205+0000 7f86042b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-09T04:37:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:22.205+0000 7f86042b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:37:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:22.205+0000 7f86042b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:37:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:22.205+0000 7f86042b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:37:22.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:22.205+0000 7f86042b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-09T04:37:25.097 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:25.124 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:25.213+0000 7f1d8aee7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-09T04:37:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:25.213+0000 7f1d8aee7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-09T04:37:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:25.213+0000 7f1d8aee7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:37:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:25.213+0000 7f1d8aee7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:37:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:25.213+0000 7f1d8aee7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:37:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:25.213+0000 7f1d8aee7640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-09T04:37:28.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:28.141 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:28.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:28.229+0000 7fa47c746640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-09T04:37:28.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:28.229+0000 7fa47c746640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-09T04:37:28.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:28.229+0000 7fa47c746640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:37:28.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:28.229+0000 7fa47c746640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:37:28.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:28.229+0000 7fa47c746640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:37:28.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:28.229+0000 7fa47c746640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-09T04:37:31.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:31.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:31.237+0000 7f716b592640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-09T04:37:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:31.237+0000 7f716b592640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-09T04:37:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:31.237+0000 7f716b592640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:37:31.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:31.237+0000 7f716b592640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:37:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:31.237+0000 7f716b592640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:37:31.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:31.237+0000 7f716b592640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-09T04:37:34.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:34.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:34.189 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:34.189 INFO:tasks.ceph:role: osd.4 2023-06-09T04:37:34.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:37:34.190 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:37:34.265 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:34.266 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:34.266 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:34.266 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:34.266 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:34.266 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:34.266 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:34.267 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:34.267 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:34.267 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:34.697 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-06-09T04:37:34.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-06-09T04:37:34.699 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:34.884 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:34.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:34.990 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:34.990 INFO:tasks.ceph:role: osd.5 2023-06-09T04:37:34.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:37:34.991 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:37:35.065 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:35.066 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:35.066 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:35.066 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:35.066 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:35.066 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:35.066 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:35.067 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:35.067 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:35.067 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:35.488 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-06-09T04:37:35.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-06-09T04:37:35.490 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:35.603 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:35.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:35.703 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:35.703 INFO:tasks.ceph:role: osd.6 2023-06-09T04:37:35.703 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:37:35.703 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:37:35.777 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:35.777 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:35.777 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:35.777 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:35.778 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:35.778 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:35.778 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:35.778 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:35.778 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:35.778 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:36.234 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-06-09T04:37:36.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-06-09T04:37:36.236 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:36.403 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:36.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:36.508 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:36.509 INFO:tasks.ceph:role: osd.7 2023-06-09T04:37:36.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:37:36.509 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:37:36.584 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:36.585 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:36.586 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:36.586 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:37.018 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2023-06-09T04:37:37.019 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2023-06-09T04:37:37.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:37.204 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:37.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:37.339+0000 7f8c4de40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-09T04:37:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:37.340+0000 7f8c4de40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-09T04:37:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:37.340+0000 7f8c4de40640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:37:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:37.340+0000 7f8c4de40640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:37:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:37.340+0000 7f8c4de40640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:37:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:37.340+0000 7f8c4de40640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-09T04:37:40.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:40.236 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:40.324+0000 7f15f4145640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-09T04:37:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:40.325+0000 7f15f4145640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-09T04:37:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:40.325+0000 7f15f4145640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:37:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:40.325+0000 7f15f4145640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:37:40.326 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:40.325+0000 7f15f4145640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:37:40.326 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:40.325+0000 7f15f4145640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-09T04:37:43.208 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:43.239 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:43.330 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:43.329+0000 7fb6fc16c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-09T04:37:43.330 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:43.330+0000 7fb6fc16c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-09T04:37:43.330 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:43.330+0000 7fb6fc16c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:37:43.331 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:43.330+0000 7fb6fc16c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:37:43.331 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:43.330+0000 7fb6fc16c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:37:43.331 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:43.330+0000 7fb6fc16c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-09T04:37:46.196 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:46.227 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:46.317 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:46.317+0000 7f8cd52b5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-09T04:37:46.317 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:46.317+0000 7f8cd52b5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-09T04:37:46.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:46.317+0000 7f8cd52b5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:37:46.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:46.317+0000 7f8cd52b5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:37:46.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:46.317+0000 7f8cd52b5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:37:46.318 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:46.317+0000 7f8cd52b5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-09T04:37:47.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:47.544 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:49.201 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:49.232 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-09T04:37:49.232 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-09T04:37:49.265 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-09T04:37:49.337 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-09T04:37:49.407 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-09T04:37:49.480 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-09T04:37:49.550 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-09T04:37:49.620 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:49.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-09T04:37:49.689 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:49.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-09T04:37:49.721 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:49.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-09T04:37:49.790 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:49.790 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-09T04:37:49.858 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:49.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-09T04:37:49.926 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:49.926 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-09T04:37:49.994 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:49.994 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-09T04:37:50.061 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:50.062 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-09T04:37:50.127 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:50.128 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-09T04:37:50.148 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:50.149 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-09T04:37:50.209 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:50.209 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-09T04:37:50.226 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:50.226 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-09T04:37:50.282 INFO:tasks.ceph:Adding keys to all mons... 2023-06-09T04:37:50.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:37:50.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:37:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2023-06-09T04:37:50.325 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkxvFXARAAgf7OtM96Ke8FUCXxHBI3Kg== 2023-06-09T04:37:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-06-09T04:37:50.325 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkRd2hCBAA/CDx+XtQObi68LCMk67Rxw== 2023-06-09T04:37:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkXp41EBAAnxvzgERGjiBN2uK7Ik5rrw== 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCCrIJkJn9BDBAAA24LsbeM7qLDhs388wcIIg== 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCFrIJkYVi5DBAAb0q+LvKEZkm9yC+8ojtC7Q== 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2023-06-09T04:37:50.326 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCIrIJkfKGuDRAAPHd4Q+yT6G0XilgTcRiivw== 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCLrIJk13UnDhAA6HlaMgGtAeuu7h3hKk4jFw== 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkqSYUBRAA47Oz3mXAfq9H/Wv5uxGEDA== 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkyckvFRAAaMBxY9/TRxanep12TWzdag== 2023-06-09T04:37:50.327 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkUHliHBAAxssDZuHqL0afakpO77fv2A== 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCRrIJkA/NWFBAAO6Dkf3oLYoCXraoCEqM5/Q== 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCUrIJkqdVkExAA4gg+Ua/Jdk0jowmE9OM4sA== 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2023-06-09T04:37:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCXrIJkdcexExAAESYNtCZe1wFD52aVNG9/QQ== 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCarIJkn/DtEhAA1odsDw+hbXfPiXAEC01NPw== 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJk8fHrIBAA7VGb53yvYzI8Y46r1nqGSA== 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout:[client.2] 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkIe1nJBAA3UUKUyeKePFBmslRh+JwwQ== 2023-06-09T04:37:50.329 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-06-09T04:37:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkgjDIJxAASSMA4JaBonc9G32FRHb5Ng== 2023-06-09T04:37:50.330 INFO:teuthology.orchestra.run.smithi026.stdout:[client.3] 2023-06-09T04:37:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCArIJkf7p8LRAAtXhGAgE8d3iHbw/attBR/Q== 2023-06-09T04:37:50.346 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2023-06-09T04:37:50.347 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkxvFXARAAgf7OtM96Ke8FUCXxHBI3Kg== 2023-06-09T04:37:50.347 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2023-06-09T04:37:50.347 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkRd2hCBAA/CDx+XtQObi68LCMk67Rxw== 2023-06-09T04:37:50.347 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2023-06-09T04:37:50.347 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkXp41EBAAnxvzgERGjiBN2uK7Ik5rrw== 2023-06-09T04:37:50.347 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCCrIJkJn9BDBAAA24LsbeM7qLDhs388wcIIg== 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCFrIJkYVi5DBAAb0q+LvKEZkm9yC+8ojtC7Q== 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCIrIJkfKGuDRAAPHd4Q+yT6G0XilgTcRiivw== 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2023-06-09T04:37:50.348 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCLrIJk13UnDhAA6HlaMgGtAeuu7h3hKk4jFw== 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkqSYUBRAA47Oz3mXAfq9H/Wv5uxGEDA== 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkyckvFRAAaMBxY9/TRxanep12TWzdag== 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkUHliHBAAxssDZuHqL0afakpO77fv2A== 2023-06-09T04:37:50.349 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCRrIJkA/NWFBAAO6Dkf3oLYoCXraoCEqM5/Q== 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCUrIJkqdVkExAA4gg+Ua/Jdk0jowmE9OM4sA== 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCXrIJkdcexExAAESYNtCZe1wFD52aVNG9/QQ== 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2023-06-09T04:37:50.350 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCarIJkn/DtEhAA1odsDw+hbXfPiXAEC01NPw== 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJk8fHrIBAA7VGb53yvYzI8Y46r1nqGSA== 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout:[client.2] 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkIe1nJBAA3UUKUyeKePFBmslRh+JwwQ== 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkgjDIJxAASSMA4JaBonc9G32FRHb5Ng== 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout:[client.3] 2023-06-09T04:37:50.351 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCArIJkf7p8LRAAtXhGAgE8d3iHbw/attBR/Q== 2023-06-09T04:37:50.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:50.373 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:50.444 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.563 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.615 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:50.779 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:50.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:50.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.947 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:50.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:51.000 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:51.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:51.054 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:51.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:51.109 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:51.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.277 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.332 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.334 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:51.389 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-09T04:37:51.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-09T04:37:51.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:51.516 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-09T04:37:51.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-09T04:37:51.569 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:51.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-09T04:37:51.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-09T04:37:51.757 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:51.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-09T04:37:51.879 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:51.881 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:51.935 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-09T04:37:51.935 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-09T04:37:51.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-09T04:37:51.939 INFO:tasks.ceph.mon.a:Started 2023-06-09T04:37:51.939 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-09T04:37:51.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-09T04:37:51.977 INFO:tasks.ceph.mon.b:Started 2023-06-09T04:37:51.977 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-09T04:37:51.978 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-09T04:37:51.979 INFO:tasks.ceph.mon.c:Started 2023-06-09T04:37:51.980 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-09T04:37:51.980 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-09T04:37:51.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-09T04:37:51.982 INFO:tasks.ceph.mgr.y:Started 2023-06-09T04:37:51.982 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-09T04:37:51.983 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-09T04:37:51.984 INFO:tasks.ceph.mgr.x:Started 2023-06-09T04:37:51.985 INFO:tasks.ceph:Setting crush tunables to default 2023-06-09T04:37:51.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2023-06-09T04:37:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.110+0000 7ff53569c700 1 Processor -- start 2023-06-09T04:37:52.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.110+0000 7ff53569c700 1 -- start start 2023-06-09T04:37:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff53569c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff5300ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff53569c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 0x7ff5300aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff53569c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53006f190 con 0x7ff530098e30 2023-06-09T04:37:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff53569c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53006e440 con 0x7ff53006e990 2023-06-09T04:37:52.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff53569c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53006e690 con 0x7ff53015c6e0 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 0x7ff5300aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff530098e30 0x7ff5300cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:45960/0 (socket says 172.21.15.26:45960) 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52f7fe700 1 -- 172.21.15.26:0/202540610 learned_addr learned my addr 172.21.15.26:0/202540610 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 0x7ff5300aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37100/0 (socket says 172.21.15.26:37100) 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52e7fc700 1 -- 172.21.15.26:0/202540610 >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 msgr2=0x7ff5300aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52e7fc700 1 -- 172.21.15.26:0/202540610 >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 msgr2=0x7ff5300aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:37:52.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/202540610 >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 0x7ff5300aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:37:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52effd700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff5300ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/202540610 >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 0x7ff5300aeb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:37:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52effd700 1 -- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 msgr2=0x7ff5300ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T04:37:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52effd700 1 -- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 msgr2=0x7ff5300ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:37:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52effd700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff5300ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:37:52.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.111+0000 7ff52effd700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff5300ae640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:37:52.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.294+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672132293 0 0) 0x7ff53006f190 con 0x7ff530098e30 2023-06-09T04:37:52.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5180035b0 con 0x7ff530098e30 2023-06-09T04:37:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 801242973 0 0) 0x7ff5180035b0 con 0x7ff530098e30 2023-06-09T04:37:52.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 msgr2=0x7ff5300ae640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff5300ae640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 msgr2=0x7ff5300aeb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 --2- 172.21.15.26:0/202540610 >> v2:172.21.15.26:3300/0 conn(0x7ff53006e990 0x7ff5300aeb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530160300 con 0x7ff530098e30 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7ff5200019f0 con 0x7ff530098e30 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 >> v1:172.21.15.26:6789/0 conn(0x7ff530098e30 legacy=0x7ff5300cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518003a00 0x7ff518003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff518004850 0x7ff518004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff518005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53006e440 con 0x7ff518003a00 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53006e690 con 0x7ff518004850 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.295+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51800bb40 con 0x7ff53015c6e0 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff518004850 0x7ff518004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52effd700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518003a00 0x7ff518003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52f7fe700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff518005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 -- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 msgr2=0x7ff518005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53015c6e0 0x7ff518005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 -- 172.21.15.26:0/202540610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518003a00 msgr2=0x7ff518003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518003a00 0x7ff518003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 -- 172.21.15.26:0/202540610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180035b0 con 0x7ff518004850 2023-06-09T04:37:52.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.296+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff518004850 0x7ff518004cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098c0 tx=0x7ff518005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3685ccd63a7fb4bb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.297+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400c070 con 0x7ff518004850 2023-06-09T04:37:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.297+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524004020 con 0x7ff518004850 2023-06-09T04:37:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.297+0000 7ff52dffb700 1 -- 172.21.15.26:0/202540610 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240043b0 con 0x7ff518004850 2023-06-09T04:37:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff53569c700 1 -- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff518004850 msgr2=0x7ff518004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff53569c700 1 --2- 172.21.15.26:0/202540610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff518004850 0x7ff518004cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098c0 tx=0x7ff518005880 comp rx=0 tx=0).stop 2023-06-09T04:37:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff52f7fe700 1 -- 172.21.15.26:0/202540610 reap_dead start 2023-06-09T04:37:52.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff53569c700 1 -- 172.21.15.26:0/202540610 shutdown_connections 2023-06-09T04:37:52.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff53569c700 1 -- 172.21.15.26:0/202540610 >> 172.21.15.26:0/202540610 conn(0x7ff530098a30 msgr2=0x7ff5300cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff53569c700 1 -- 172.21.15.26:0/202540610 shutdown_connections 2023-06-09T04:37:52.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.298+0000 7ff53569c700 1 -- 172.21.15.26:0/202540610 wait complete. 2023-06-09T04:37:52.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.300+0000 7ff53569c700 1 Processor -- start 2023-06-09T04:37:52.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.300+0000 7ff53569c700 1 -- start start 2023-06-09T04:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff53569c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 0x7ff53014dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff53569c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300c72c0 0x7ff5300c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff53569c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5300c3290 0x7ff5300c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff53569c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301541d0 con 0x7ff518004850 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff53569c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300c7c70 con 0x7ff5300c72c0 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff53569c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300c2e00 con 0x7ff5300c3290 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 0x7ff53014dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 0x7ff53014dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37130/0 (socket says 172.21.15.26:37130) 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 -- 172.21.15.26:0/3854162459 learned_addr learned my addr 172.21.15.26:0/3854162459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52f7fe700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5300c3290 0x7ff5300c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52e7fc700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300c72c0 0x7ff5300c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 -- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5300c3290 msgr2=0x7ff5300c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5300c3290 0x7ff5300c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 -- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300c72c0 msgr2=0x7ff5300c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300c72c0 0x7ff5300c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.301+0000 7ff52effd700 1 -- 172.21.15.26:0/3854162459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300c7ea0 con 0x7ff518004850 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff52effd700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 0x7ff53014dcf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5280115d0 tx=0x7ff5280118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528015890 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5280159f0 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5300c8180 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528015da0 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5300c2a90 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff52801e450 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.302+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff528014720 con 0x7ff518004850 2023-06-09T04:37:52.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.303+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff530067180 con 0x7ff518004850 2023-06-09T04:37:52.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.305+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff528023060 con 0x7ff518004850 2023-06-09T04:37:52.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.386+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff5300ce6f0 con 0x7ff518004850 2023-06-09T04:37:52.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.389+0000 7ff5177fe700 1 -- 172.21.15.26:0/3854162459 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff52802d090 con 0x7ff518004850 2023-06-09T04:37:52.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.389+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 msgr2=0x7ff53014dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.389+0000 7ff53569c700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 0x7ff53014dcf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5280115d0 tx=0x7ff5280118e0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.389+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 shutdown_connections 2023-06-09T04:37:52.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.390+0000 7ff53569c700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5300c3290 0x7ff5300c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.390+0000 7ff53569c700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff518004850 0x7ff53014dcf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.390+0000 7ff53569c700 1 --2- 172.21.15.26:0/3854162459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300c72c0 0x7ff5300c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.390+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 >> 172.21.15.26:0/3854162459 conn(0x7ff530098a30 msgr2=0x7ff5300cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.390+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 shutdown_connections 2023-06-09T04:37:52.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:52.390+0000 7ff53569c700 1 -- 172.21.15.26:0/3854162459 wait complete. 2023-06-09T04:37:52.392 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-06-09T04:37:52.402 INFO:tasks.ceph:check_enable_crimson: False 2023-06-09T04:37:52.403 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-09T04:37:52.403 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:52.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-09T04:37:52.414 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:52.414+0000 7efe533f3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:37:52.417 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:52.417+0000 7ff0f98e7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:37:52.430 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:52.430 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-09T04:37:52.479 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:52.478+0000 7efe533f3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:52.488 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:52.487+0000 7ff0f98e7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:52.497 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:52.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-09T04:37:52.553 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:52.553+0000 7efe533f3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:37:52.563 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:37:52.564 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-09T04:37:52.570 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:52.569+0000 7ff0f98e7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:37:52.599 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:52.600 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-09T04:37:52.625 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:52.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-09T04:37:52.633 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:52.633+0000 7efe533f3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:37:52.657 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:52.656+0000 7ff0f98e7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:37:52.659 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:52.659 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-09T04:37:52.725 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:37:52.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-09T04:37:52.784 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:52.784+0000 7efe533f3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:37:52.790 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 1d5fe96e-ac4c-4263-8ed2-7db23de9c606 0 2023-06-09T04:37:52.806 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:52.805+0000 7ff0f98e7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:37:52.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.952+0000 7f86484ff700 1 Processor -- start 2023-06-09T04:37:52.952 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.952+0000 7f86484ff700 1 -- start start 2023-06-09T04:37:52.953 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.952+0000 7f86484ff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f864015c550 0x7f8640160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f86484ff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86400d0740 0x7f86400d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f86484ff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86400cce70 con 0x7f86400cc620 2023-06-09T04:37:52.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f86484ff700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8640161030 con 0x7f864015c550 2023-06-09T04:37:52.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f86484ff700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8640160790 con 0x7f86400d0740 2023-06-09T04:37:52.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8646a9c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86400d0740 0x7f86400d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.954 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8645a9a700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f86400cc620 0x7f86400caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42124/0 (socket says 172.21.15.104:42124) 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8645a9a700 1 -- 172.21.15.104:0/1723208013 learned_addr learned my addr 172.21.15.104:0/1723208013 (peer_addr_for_me v1:172.21.15.104:0/0) 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f864629b700 1 --2- 172.21.15.104:0/1723208013 >> v2:172.21.15.26:3300/0 conn(0x7f864015c550 0x7f8640160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8645299700 1 -- 172.21.15.104:0/1723208013 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446227526 0 0) 0x7f86400cce70 con 0x7f86400cc620 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8646a9c700 1 -- 172.21.15.104:0/1723208013 >> v2:172.21.15.26:3300/0 conn(0x7f864015c550 msgr2=0x7f8640160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8646a9c700 1 --2- 172.21.15.104:0/1723208013 >> v2:172.21.15.26:3300/0 conn(0x7f864015c550 0x7f8640160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8646a9c700 1 -- 172.21.15.104:0/1723208013 >> v1:172.21.15.104:6789/0 conn(0x7f86400cc620 legacy=0x7f86400caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8646a9c700 1 -- 172.21.15.104:0/1723208013 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640160a70 con 0x7f86400d0740 2023-06-09T04:37:52.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8646a9c700 1 --2- 172.21.15.104:0/1723208013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86400d0740 0x7f86400d0bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8638009d90 tx=0x7f863800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba61e3b0f7d23089 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.956 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8645299700 1 -- 172.21.15.104:0/1723208013 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800e070 con 0x7f86400d0740 2023-06-09T04:37:52.956 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8645299700 1 -- 172.21.15.104:0/1723208013 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800bb20 con 0x7f86400d0740 2023-06-09T04:37:52.956 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.953+0000 7f8645299700 1 -- 172.21.15.104:0/1723208013 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638012430 con 0x7f86400d0740 2023-06-09T04:37:52.958 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 -- 172.21.15.104:0/1723208013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86400d0740 msgr2=0x7f86400d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.958 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 --2- 172.21.15.104:0/1723208013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86400d0740 0x7f86400d0bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8638009d90 tx=0x7f863800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 -- 172.21.15.104:0/1723208013 shutdown_connections 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 --2- 172.21.15.104:0/1723208013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86400d0740 0x7f86400d0bb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 --2- 172.21.15.104:0/1723208013 >> v2:172.21.15.26:3300/0 conn(0x7f864015c550 0x7f8640160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 -- 172.21.15.104:0/1723208013 >> 172.21.15.104:0/1723208013 conn(0x7f8640089fc0 msgr2=0x7f864008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 -- 172.21.15.104:0/1723208013 shutdown_connections 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.954+0000 7f86484ff700 1 -- 172.21.15.104:0/1723208013 wait complete. 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.956+0000 7f86484ff700 1 Processor -- start 2023-06-09T04:37:52.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.956+0000 7f86484ff700 1 -- start start 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 0x7f86400af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86400d0740 0x7f86400b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f864015c550 0x7f86400b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864014e8c0 con 0x7f86400d0740 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400aebc0 con 0x7f86400cc620 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86400ae0f0 con 0x7f864015c550 2023-06-09T04:37:52.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 0x7f86400af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 0x7f86400af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48800/0 (socket says 172.21.15.104:48800) 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 -- 172.21.15.104:0/2825819595 learned_addr learned my addr 172.21.15.104:0/2825819595 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f8646a9c700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f864015c550 0x7f86400b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f8645a9a700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86400d0740 0x7f86400b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 -- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f864015c550 msgr2=0x7f86400b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f864015c550 0x7f86400b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 -- 172.21.15.104:0/2825819595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86400d0740 msgr2=0x7f86400b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86400d0740 0x7f86400b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 -- 172.21.15.104:0/2825819595 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8638009a70 con 0x7f86400cc620 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f8646a9c700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f864015c550 0x7f86400b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f864629b700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 0x7f86400af610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e900 tx=0x7f863c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c013680 con 0x7f86400cc620 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c0137e0 con 0x7f86400cc620 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86400ae3d0 con 0x7f86400cc620 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c013b50 con 0x7f86400cc620 2023-06-09T04:37:52.962 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.957+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86400af0f0 con 0x7f86400cc620 2023-06-09T04:37:52.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.958+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f863c01c450 con 0x7f86400cc620 2023-06-09T04:37:52.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.958+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f863c00c900 con 0x7f86400cc620 2023-06-09T04:37:52.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.958+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86400af2b0 con 0x7f86400cc620 2023-06-09T04:37:52.963 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:52.960+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f863c03bb00 con 0x7f86400cc620 2023-06-09T04:37:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.044+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d5fe96e-ac4c-4263-8ed2-7db23de9c606", "id": 0} v 0) v1 -- 0x7f86400af460 con 0x7f86400cc620 2023-06-09T04:37:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.047+0000 7f8636ffd700 1 -- 172.21.15.104:0/2825819595 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d5fe96e-ac4c-4263-8ed2-7db23de9c606", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f863c02a070 con 0x7f86400cc620 2023-06-09T04:37:53.047 INFO:teuthology.orchestra.run.smithi104.stdout:0 2023-06-09T04:37:53.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 msgr2=0x7f86400af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.048 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 0x7f86400af610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e900 tx=0x7f863c00ec10 comp rx=0 tx=0).stop 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 shutdown_connections 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f864015c550 0x7f86400b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86400cc620 0x7f86400af610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 --2- 172.21.15.104:0/2825819595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86400d0740 0x7f86400b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 >> 172.21.15.104:0/2825819595 conn(0x7f8640089fc0 msgr2=0x7f86400b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 shutdown_connections 2023-06-09T04:37:53.049 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.048+0000 7f86484ff700 1 -- 172.21.15.104:0/2825819595 wait complete. 2023-06-09T04:37:53.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new a49b871f-09ea-470c-a93b-b58e6a0a9c5a 1 2023-06-09T04:37:53.132 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:53.132+0000 7efe533f3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:37:53.144 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:53.144+0000 7ff0f98e7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:37:53.178 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.178+0000 7fe4a1b72700 1 Processor -- start 2023-06-09T04:37:53.179 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.178+0000 7fe4a1b72700 1 -- start start 2023-06-09T04:37:53.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe4a1b72700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe49c15c200 0x7fe49c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe4a1b72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe49c06b2b0 0x7fe49c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe4a1b72700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c071ad0 con 0x7fe49c0ce700 2023-06-09T04:37:53.180 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe4a1b72700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0718c0 con 0x7fe49c06b2b0 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe4a1b72700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c070b40 con 0x7fe49c15c200 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49b7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe49c15c200 0x7fe49c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49bfff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe49c0ce700 0x7fe49c069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42140/0 (socket says 172.21.15.104:42140) 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49b7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe49c15c200 0x7fe49c0cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48806/0 (socket says 172.21.15.104:48806) 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49bfff700 1 -- 172.21.15.104:0/3054444323 learned_addr learned my addr 172.21.15.104:0/3054444323 (peer_addr_for_me v1:172.21.15.104:0/0) 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49affd700 1 --2- 172.21.15.104:0/3054444323 >> v2:172.21.15.26:3300/0 conn(0x7fe49c06b2b0 0x7fe49c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.181 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49b7fe700 1 -- 172.21.15.104:0/3054444323 >> v2:172.21.15.26:3300/0 conn(0x7fe49c06b2b0 msgr2=0x7fe49c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49b7fe700 1 --2- 172.21.15.104:0/3054444323 >> v2:172.21.15.26:3300/0 conn(0x7fe49c06b2b0 0x7fe49c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49b7fe700 1 -- 172.21.15.104:0/3054444323 >> v1:172.21.15.104:6789/0 conn(0x7fe49c0ce700 legacy=0x7fe49c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49a7fc700 1 -- 172.21.15.104:0/3054444323 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873335647 0 0) 0x7fe49c071ad0 con 0x7fe49c0ce700 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.179+0000 7fe49b7fe700 1 -- 172.21.15.104:0/3054444323 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c070e20 con 0x7fe49c15c200 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe49b7fe700 1 --2- 172.21.15.104:0/3054444323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0cb470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0ceeb0 tx=0x7fe48c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eedf27673daedfee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe49a7fc700 1 -- 172.21.15.104:0/3054444323 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00e070 con 0x7fe49c15c200 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe49a7fc700 1 -- 172.21.15.104:0/3054444323 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c00bb20 con 0x7fe49c15c200 2023-06-09T04:37:53.182 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe49a7fc700 1 -- 172.21.15.104:0/3054444323 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c012430 con 0x7fe49c15c200 2023-06-09T04:37:53.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 -- 172.21.15.104:0/3054444323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 msgr2=0x7fe49c0cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/3054444323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0cb470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0ceeb0 tx=0x7fe48c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:53.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 -- 172.21.15.104:0/3054444323 shutdown_connections 2023-06-09T04:37:53.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/3054444323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0cb470 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/3054444323 >> v2:172.21.15.26:3300/0 conn(0x7fe49c06b2b0 0x7fe49c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.185 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 -- 172.21.15.104:0/3054444323 >> 172.21.15.104:0/3054444323 conn(0x7fe49c0cb9d0 msgr2=0x7fe49c0cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 -- 172.21.15.104:0/3054444323 shutdown_connections 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.180+0000 7fe4a1b72700 1 -- 172.21.15.104:0/3054444323 wait complete. 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.182+0000 7fe4a1b72700 1 Processor -- start 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.182+0000 7fe4a1b72700 1 -- start start 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe4a1b72700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe49c06b2b0 0x7fe49c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe4a1b72700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 0x7fe49c0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe4a1b72700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.186 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe4a1b72700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0af7e0 con 0x7fe49c06b2b0 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe4a1b72700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0b1d80 con 0x7fe49c15c200 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe4a1b72700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0b2060 con 0x7fe49c0ce700 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe49affd700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 0x7fe49c0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe49affd700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 0x7fe49c0afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:40764/0 (socket says 172.21.15.104:40764) 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe49affd700 1 -- 172.21.15.104:0/1112327575 learned_addr learned my addr 172.21.15.104:0/1112327575 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe49b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe49c06b2b0 0x7fe49c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.187 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.183+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48816/0 (socket says 172.21.15.104:48816) 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49b7fe700 1 -- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 msgr2=0x7fe49c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49b7fe700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 0x7fe49c0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49b7fe700 1 -- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 msgr2=0x7fe49c0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49b7fe700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49b7fe700 1 -- 172.21.15.104:0/1112327575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c009a70 con 0x7fe49c06b2b0 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49affd700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 0x7fe49c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:53.188 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49bfff700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe49b7fe700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe49c06b2b0 0x7fe49c0c4ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe48c016000 tx=0x7fe48c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c012430 con 0x7fe49c06b2b0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c020070 con 0x7fe49c06b2b0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c0b2340 con 0x7fe49c06b2b0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c004280 con 0x7fe49c06b2b0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c0c5400 con 0x7fe49c06b2b0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe48c0046e0 con 0x7fe49c06b2b0 2023-06-09T04:37:53.189 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.184+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe48c022070 con 0x7fe49c06b2b0 2023-06-09T04:37:53.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.185+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c0c5590 con 0x7fe49c06b2b0 2023-06-09T04:37:53.190 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.187+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe48c027840 con 0x7fe49c06b2b0 2023-06-09T04:37:53.211 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:53.211+0000 7efe533f3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:37:53.223 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:53.222+0000 7ff0f98e7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:37:53.270 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.270+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a49b871f-09ea-470c-a93b-b58e6a0a9c5a", "id": 1} v 0) v1 -- 0x7fe49c067180 con 0x7fe49c06b2b0 2023-06-09T04:37:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.272+0000 7fe493fff700 1 -- 172.21.15.104:0/1112327575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a49b871f-09ea-470c-a93b-b58e6a0a9c5a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe48c0279e0 con 0x7fe49c06b2b0 2023-06-09T04:37:53.273 INFO:teuthology.orchestra.run.smithi104.stdout:1 2023-06-09T04:37:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe49c06b2b0 msgr2=0x7fe49c0c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe49c06b2b0 0x7fe49c0c4ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe48c016000 tx=0x7fe48c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 shutdown_connections 2023-06-09T04:37:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe49c15c200 0x7fe49c0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe49c06b2b0 0x7fe49c0c4ec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 --2- 172.21.15.104:0/1112327575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe49c0ce700 0x7fe49c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 >> 172.21.15.104:0/1112327575 conn(0x7fe49c0cb9d0 msgr2=0x7fe49c0ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 shutdown_connections 2023-06-09T04:37:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.273+0000 7fe4a1b72700 1 -- 172.21.15.104:0/1112327575 wait complete. 2023-06-09T04:37:53.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new f27e1ade-4207-470b-a232-ded8a7c9b8c8 2 2023-06-09T04:37:53.349 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:53.349+0000 7efe533f3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:37:53.353 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:53.352+0000 7ff0f98e7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:37:53.404 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 Processor -- start 2023-06-09T04:37:53.404 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 -- start start 2023-06-09T04:37:53.405 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe79015c6e0 0x7fe7900ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe790098e30 0x7fe7900aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79006f190 con 0x7fe79006e990 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79006e440 con 0x7fe79015c6e0 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.404+0000 7fe79694e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79006e690 con 0x7fe790098e30 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe790098e30 0x7fe7900aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe790098e30 0x7fe7900aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48822/0 (socket says 172.21.15.104:48822) 2023-06-09T04:37:53.406 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 -- 172.21.15.104:0/3871169530 learned_addr learned my addr 172.21.15.104:0/3871169530 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe78ffff700 1 --2- 172.21.15.104:0/3871169530 >> v2:172.21.15.26:3300/0 conn(0x7fe79015c6e0 0x7fe7900ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 -- 172.21.15.104:0/3871169530 >> v2:172.21.15.26:3300/0 conn(0x7fe79015c6e0 msgr2=0x7fe7900ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 --2- 172.21.15.104:0/3871169530 >> v2:172.21.15.26:3300/0 conn(0x7fe79015c6e0 0x7fe7900ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 -- 172.21.15.104:0/3871169530 >> v1:172.21.15.26:6789/0 conn(0x7fe79006e990 legacy=0x7fe7900cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 -- 172.21.15.104:0/3871169530 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790160300 con 0x7fe790098e30 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe794eeb700 1 --2- 172.21.15.104:0/3871169530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790098e30 0x7fe7900aeb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe790072140 tx=0x7fe78800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89036564d7e014a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe78effd700 1 -- 172.21.15.104:0/3871169530 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800e070 con 0x7fe790098e30 2023-06-09T04:37:53.407 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe78effd700 1 -- 172.21.15.104:0/3871169530 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800b910 con 0x7fe790098e30 2023-06-09T04:37:53.408 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.405+0000 7fe78effd700 1 -- 172.21.15.104:0/3871169530 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800bcc0 con 0x7fe790098e30 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 -- 172.21.15.104:0/3871169530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790098e30 msgr2=0x7fe7900aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 --2- 172.21.15.104:0/3871169530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790098e30 0x7fe7900aeb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe790072140 tx=0x7fe78800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 -- 172.21.15.104:0/3871169530 shutdown_connections 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 --2- 172.21.15.104:0/3871169530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790098e30 0x7fe7900aeb80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 --2- 172.21.15.104:0/3871169530 >> v2:172.21.15.26:3300/0 conn(0x7fe79015c6e0 0x7fe7900ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 -- 172.21.15.104:0/3871169530 >> 172.21.15.104:0/3871169530 conn(0x7fe790098a30 msgr2=0x7fe7900cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.410 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 -- 172.21.15.104:0/3871169530 shutdown_connections 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.406+0000 7fe79694e700 1 -- 172.21.15.104:0/3871169530 wait complete. 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.407+0000 7fe79694e700 1 Processor -- start 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 -- start start 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 0x7fe7901f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe790098e30 0x7fe7900c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 0x7fe7900c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901567c0 con 0x7fe790098e30 2023-06-09T04:37:53.411 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901f1f20 con 0x7fe79015c6e0 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.408+0000 7fe79694e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7901f55e0 con 0x7fe79006e990 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78ffff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 0x7fe7901f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 0x7fe7900c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78ffff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 0x7fe7901f19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:40774/0 (socket says 172.21.15.104:40774) 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 0x7fe7900c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48828/0 (socket says 172.21.15.104:48828) 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78ffff700 1 -- 172.21.15.104:0/1927495839 learned_addr learned my addr 172.21.15.104:0/1927495839 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78f7fe700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe790098e30 0x7fe7900c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 -- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 msgr2=0x7fe7901f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 0x7fe7901f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 -- 172.21.15.104:0/1927495839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe790098e30 msgr2=0x7fe7900c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe790098e30 0x7fe7900c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 -- 172.21.15.104:0/1927495839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788009b30 con 0x7fe79015c6e0 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78ffff700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 0x7fe7901f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe794eeb700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 0x7fe7900c5c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe788015000 tx=0x7fe788004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.413 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788004880 con 0x7fe79015c6e0 2023-06-09T04:37:53.414 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880099b0 con 0x7fe79015c6e0 2023-06-09T04:37:53.414 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7901f58c0 con 0x7fe79015c6e0 2023-06-09T04:37:53.414 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78801b670 con 0x7fe79015c6e0 2023-06-09T04:37:53.414 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.409+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7901f5e80 con 0x7fe79015c6e0 2023-06-09T04:37:53.415 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.410+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe78801bad0 con 0x7fe79015c6e0 2023-06-09T04:37:53.415 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.410+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe788024d20 con 0x7fe79015c6e0 2023-06-09T04:37:53.415 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.410+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe790067180 con 0x7fe79015c6e0 2023-06-09T04:37:53.415 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.412+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe788042b00 con 0x7fe79015c6e0 2023-06-09T04:37:53.437 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:53.436+0000 7efe533f3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:37:53.449 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:53.448+0000 7ff0f98e7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:37:53.496 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.496+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f27e1ade-4207-470b-a232-ded8a7c9b8c8", "id": 2} v 0) v1 -- 0x7fe7900ce6f0 con 0x7fe79015c6e0 2023-06-09T04:37:53.500 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.499+0000 7fe78cff9700 1 -- 172.21.15.104:0/1927495839 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f27e1ade-4207-470b-a232-ded8a7c9b8c8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe788031030 con 0x7fe79015c6e0 2023-06-09T04:37:53.500 INFO:teuthology.orchestra.run.smithi104.stdout:2 2023-06-09T04:37:53.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 msgr2=0x7fe7900c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 0x7fe7900c5c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe788015000 tx=0x7fe788004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 shutdown_connections 2023-06-09T04:37:53.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe79015c6e0 0x7fe7900c5c00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe79006e990 0x7fe7901f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.501 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 --2- 172.21.15.104:0/1927495839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe790098e30 0x7fe7900c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.502 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 >> 172.21.15.104:0/1927495839 conn(0x7fe790098a30 msgr2=0x7fe7900ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.502 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 shutdown_connections 2023-06-09T04:37:53.502 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.500+0000 7fe79694e700 1 -- 172.21.15.104:0/1927495839 wait complete. 2023-06-09T04:37:53.512 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2 3 2023-06-09T04:37:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.636+0000 7f0aa0910700 1 Processor -- start 2023-06-09T04:37:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.637+0000 7f0aa0910700 1 -- start start 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.637+0000 7f0aa0910700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.637+0000 7f0aa0910700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0a9c06e990 0x7f0a9c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.637+0000 7f0aa0910700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c06f190 con 0x7f0a9c098e30 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.637+0000 7f0aa0910700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c06e440 con 0x7f0a9c06e990 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.637+0000 7f0aa0910700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c06e690 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.639 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:40780/0 (socket says 172.21.15.104:40780) 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 -- 172.21.15.104:0/1111634553 learned_addr learned my addr 172.21.15.104:0/1111634553 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a99d9b700 1 --2- 172.21.15.104:0/1111634553 >> v2:172.21.15.26:3300/0 conn(0x7f0a9c06e990 0x7f0a9c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 -- 172.21.15.104:0/1111634553 >> v2:172.21.15.26:3300/0 conn(0x7f0a9c06e990 msgr2=0x7f0a9c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 --2- 172.21.15.104:0/1111634553 >> v2:172.21.15.26:3300/0 conn(0x7f0a9c06e990 0x7f0a9c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 -- 172.21.15.104:0/1111634553 >> v1:172.21.15.26:6789/0 conn(0x7f0a9c098e30 legacy=0x7f0a9c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 -- 172.21.15.104:0/1111634553 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c160300 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.640 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9a59c700 1 --2- 172.21.15.104:0/1111634553 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0ae640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c006fd0 tx=0x7f0a8c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b6d0791b87e2a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9959a700 1 -- 172.21.15.104:0/1111634553 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c005e30 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9959a700 1 -- 172.21.15.104:0/1111634553 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c004030 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.641 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.638+0000 7f0a9959a700 1 -- 172.21.15.104:0/1111634553 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0043e0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 -- 172.21.15.104:0/1111634553 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 msgr2=0x7f0a9c0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 --2- 172.21.15.104:0/1111634553 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0ae640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c006fd0 tx=0x7f0a8c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 -- 172.21.15.104:0/1111634553 shutdown_connections 2023-06-09T04:37:53.643 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 --2- 172.21.15.104:0/1111634553 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0ae640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 --2- 172.21.15.104:0/1111634553 >> v2:172.21.15.26:3300/0 conn(0x7f0a9c06e990 0x7f0a9c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 -- 172.21.15.104:0/1111634553 >> 172.21.15.104:0/1111634553 conn(0x7f0a9c098a30 msgr2=0x7f0a9c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 -- 172.21.15.104:0/1111634553 shutdown_connections 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.639+0000 7f0aa0910700 1 -- 172.21.15.104:0/1111634553 wait complete. 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.641+0000 7f0aa0910700 1 Processor -- start 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.641+0000 7f0aa0910700 1 -- start start 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0aa0910700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a9c06e990 0x7f0a9c0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.644 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0aa0910700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 0x7f0a9c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0aa0910700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0aa0910700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b10d0 con 0x7f0a9c06e990 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0aa0910700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b0b10 con 0x7f0a9c098e30 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0aa0910700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b0df0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a99d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 0x7f0a9c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.645 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a99d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 0x7f0a9c153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48838/0 (socket says 172.21.15.104:48838) 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a99d9b700 1 -- 172.21.15.104:0/3191266444 learned_addr learned my addr 172.21.15.104:0/3191266444 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9a59c700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a9c06e990 0x7f0a9c0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 -- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 msgr2=0x7f0a9c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 0x7f0a9c153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 -- 172.21.15.104:0/3191266444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a9c06e990 msgr2=0x7f0a9c0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a9c06e990 0x7f0a9c0c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 -- 172.21.15.104:0/3191266444 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c009500 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a99d9b700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 0x7f0a9c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a9ad9d700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0b01a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400cae0 tx=0x7f0a9400cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94003c00 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a94003d60 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.642+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400aa20 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.643+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c0b35a0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.643+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c154200 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.643+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0a940050d0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.643+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0a94012900 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.644+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c1543c0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.648 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.646+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0a94012470 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.728 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.727+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd new", "uuid": "358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2", "id": 3} v 0) v1 -- 0x7f0a9c0b3ac0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.731 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.731+0000 7f0a8affd700 1 -- 172.21.15.104:0/3191266444 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0a9c0b3ac0 con 0x7f0a9c15c6e0 2023-06-09T04:37:53.731 INFO:teuthology.orchestra.run.smithi104.stdout:3 2023-06-09T04:37:53.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 msgr2=0x7f0a9c0b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0b01a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400cae0 tx=0x7f0a9400cdf0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.732 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 shutdown_connections 2023-06-09T04:37:53.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0a9c15c6e0 0x7f0a9c0b01a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a9c06e990 0x7f0a9c0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 --2- 172.21.15.104:0/3191266444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c098e30 0x7f0a9c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 >> 172.21.15.104:0/3191266444 conn(0x7f0a9c098a30 msgr2=0x7f0a9c0ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 shutdown_connections 2023-06-09T04:37:53.733 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.732+0000 7f0aa0910700 1 -- 172.21.15.104:0/3191266444 wait complete. 2023-06-09T04:37:53.743 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0 4 2023-06-09T04:37:53.863 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.863+0000 7fe2f7a30700 1 Processor -- start 2023-06-09T04:37:53.863 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.863+0000 7fe2f7a30700 1 -- start start 2023-06-09T04:37:53.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f7a30700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2f00aed90 0x7fe2f00c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f7a30700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00ca370 0x7fe2f00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f7a30700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f0159880 con 0x7fe2f00ceae0 2023-06-09T04:37:53.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f7a30700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00cda30 con 0x7fe2f00aed90 2023-06-09T04:37:53.865 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f7a30700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00ca7e0 con 0x7fe2f00ca370 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f57cc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2f00aed90 0x7fe2f00c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f4fcb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00ca370 0x7fe2f00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f5fcd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe2f00ceae0 0x7fe2f00cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42174/0 (socket says 172.21.15.104:42174) 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f5fcd700 1 -- 172.21.15.104:0/1994343944 learned_addr learned my addr 172.21.15.104:0/1994343944 (peer_addr_for_me v1:172.21.15.104:0/0) 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f57cc700 1 -- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00ca370 msgr2=0x7fe2f00ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f57cc700 1 --2- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00ca370 0x7fe2f00ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.866 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f57cc700 1 -- 172.21.15.104:0/1994343944 >> v1:172.21.15.104:6789/0 conn(0x7fe2f00ceae0 legacy=0x7fe2f00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2e7fff700 1 -- 172.21.15.104:0/1994343944 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698985878 0 0) 0x7fe2f0159880 con 0x7fe2f00ceae0 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f57cc700 1 -- 172.21.15.104:0/1994343944 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f006cff0 con 0x7fe2f00aed90 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f4fcb700 1 --2- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00ca370 0x7fe2f00ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.864+0000 7fe2f57cc700 1 --2- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00aed90 0x7fe2f00c9e30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009850 tx=0x7fe2ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a3a6c2a1a3d70c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2e7fff700 1 -- 172.21.15.104:0/1994343944 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec005e30 con 0x7fe2f00aed90 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2e7fff700 1 -- 172.21.15.104:0/1994343944 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec006030 con 0x7fe2f00aed90 2023-06-09T04:37:53.867 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2e7fff700 1 -- 172.21.15.104:0/1994343944 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0063c0 con 0x7fe2f00aed90 2023-06-09T04:37:53.869 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00aed90 msgr2=0x7fe2f00c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00aed90 0x7fe2f00c9e30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009850 tx=0x7fe2ec009b60 comp rx=0 tx=0).stop 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1994343944 shutdown_connections 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00aed90 0x7fe2f00c9e30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1994343944 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00ca370 0x7fe2f00ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1994343944 >> 172.21.15.104:0/1994343944 conn(0x7fe2f0098a30 msgr2=0x7fe2f00cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1994343944 shutdown_connections 2023-06-09T04:37:53.870 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.865+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1994343944 wait complete. 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.866+0000 7fe2f7a30700 1 Processor -- start 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 -- start start 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00aed90 0x7fe2f014ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 0x7fe2f00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00ceae0 0x7fe2f006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b4460 con 0x7fe2f00ceae0 2023-06-09T04:37:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b35a0 con 0x7fe2f00ca370 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.867+0000 7fe2f7a30700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b2990 con 0x7fe2f00aed90 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 0x7fe2f00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 0x7fe2f00b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48848/0 (socket says 172.21.15.104:48848) 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f57cc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00aed90 0x7fe2f014ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 -- 172.21.15.104:0/1279485139 learned_addr learned my addr 172.21.15.104:0/1279485139 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f5fcd700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00ceae0 0x7fe2f006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 -- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00aed90 msgr2=0x7fe2f014ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00aed90 0x7fe2f014ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 -- 172.21.15.104:0/1279485139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00ceae0 msgr2=0x7fe2f006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00ceae0 0x7fe2f006dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 -- 172.21.15.104:0/1279485139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00094a0 con 0x7fe2f00ca370 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f5fcd700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00ceae0 0x7fe2f006dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f4fcb700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 0x7fe2f00b4fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000ebe0 tx=0x7fe2e000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000c850 con 0x7fe2f00ca370 2023-06-09T04:37:53.873 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000c9b0 con 0x7fe2f00ca370 2023-06-09T04:37:53.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec009430 con 0x7fe2f00ca370 2023-06-09T04:37:53.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000cd40 con 0x7fe2f00ca370 2023-06-09T04:37:53.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.868+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f00b2f50 con 0x7fe2f00ca370 2023-06-09T04:37:53.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.869+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe2e0005d20 con 0x7fe2f00ca370 2023-06-09T04:37:53.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.869+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe2e0006840 con 0x7fe2f00ca370 2023-06-09T04:37:53.874 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.869+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0067180 con 0x7fe2f00ca370 2023-06-09T04:37:53.875 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.871+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe2e0021060 con 0x7fe2f00ca370 2023-06-09T04:37:53.894 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:53.894+0000 7efe533f3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:37:53.899 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:53.898+0000 7ff0f98e7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:37:53.955 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.955+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0", "id": 4} v 0) v1 -- 0x7fe2f01531e0 con 0x7fe2f00ca370 2023-06-09T04:37:53.959 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.958+0000 7fe2e5ffb700 1 -- 172.21.15.104:0/1279485139 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2e0017070 con 0x7fe2f00ca370 2023-06-09T04:37:53.959 INFO:teuthology.orchestra.run.smithi104.stdout:4 2023-06-09T04:37:53.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 msgr2=0x7fe2f00b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 0x7fe2f00b4fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000ebe0 tx=0x7fe2e000eef0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 shutdown_connections 2023-06-09T04:37:53.960 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00ceae0 0x7fe2f006dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2f00aed90 0x7fe2f014ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 --2- 172.21.15.104:0/1279485139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2f00ca370 0x7fe2f00b4fb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.959+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 >> 172.21.15.104:0/1279485139 conn(0x7fe2f0098a30 msgr2=0x7fe2f006eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.960+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 shutdown_connections 2023-06-09T04:37:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:53.960+0000 7fe2f7a30700 1 -- 172.21.15.104:0/1279485139 wait complete. 2023-06-09T04:37:53.972 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 6269c0a7-b639-4d47-b782-365766e42068 5 2023-06-09T04:37:54.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.096+0000 7f41a5cda700 1 Processor -- start 2023-06-09T04:37:54.096 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.096+0000 7f41a5cda700 1 -- start start 2023-06-09T04:37:54.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f41a5cda700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41a01591d0 0x7f41a01595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f41a5cda700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 0x7f41a00ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f41a5cda700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a00ca790 con 0x7f41a00cd530 2023-06-09T04:37:54.098 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f41a5cda700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a0159ae0 con 0x7f41a01591d0 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f41a5cda700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00ca5a0 con 0x7f41a00c9c10 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 0x7f41a00ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419f7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41a01591d0 0x7f41a01595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 0x7f41a00ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:40804/0 (socket says 172.21.15.104:40804) 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 -- 172.21.15.104:0/515689793 learned_addr learned my addr 172.21.15.104:0/515689793 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 -- 172.21.15.104:0/515689793 >> v2:172.21.15.104:3300/0 conn(0x7f41a01591d0 msgr2=0x7f41a01595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:54.099 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419e7fc700 1 -- 172.21.15.104:0/515689793 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53536678 0 0) 0x7f41a00ca790 con 0x7f41a00cd530 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 --2- 172.21.15.104:0/515689793 >> v2:172.21.15.104:3300/0 conn(0x7f41a01591d0 0x7f41a01595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 -- 172.21.15.104:0/515689793 >> v1:172.21.15.104:6789/0 conn(0x7f41a00cd530 legacy=0x7f41a006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.097+0000 7f419effd700 1 -- 172.21.15.104:0/515689793 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a00caa70 con 0x7f41a00c9c10 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f419effd700 1 --2- 172.21.15.104:0/515689793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 0x7f41a00ca060 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41940098f0 tx=0x7f4194009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19330a18e6ec11ba server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f419e7fc700 1 -- 172.21.15.104:0/515689793 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194011830 con 0x7f41a00c9c10 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f419e7fc700 1 -- 172.21.15.104:0/515689793 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194011990 con 0x7f41a00c9c10 2023-06-09T04:37:54.100 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f419e7fc700 1 -- 172.21.15.104:0/515689793 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194011d20 con 0x7f41a00c9c10 2023-06-09T04:37:54.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 -- 172.21.15.104:0/515689793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 msgr2=0x7f41a00ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 --2- 172.21.15.104:0/515689793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 0x7f41a00ca060 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41940098f0 tx=0x7f4194009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:54.103 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 -- 172.21.15.104:0/515689793 shutdown_connections 2023-06-09T04:37:54.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 --2- 172.21.15.104:0/515689793 >> v2:172.21.15.104:3300/0 conn(0x7f41a01591d0 0x7f41a01595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 --2- 172.21.15.104:0/515689793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a00c9c10 0x7f41a00ca060 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 -- 172.21.15.104:0/515689793 >> 172.21.15.104:0/515689793 conn(0x7f41a00cb9d0 msgr2=0x7f41a00cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 -- 172.21.15.104:0/515689793 shutdown_connections 2023-06-09T04:37:54.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.098+0000 7f41a5cda700 1 -- 172.21.15.104:0/515689793 wait complete. 2023-06-09T04:37:54.104 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.100+0000 7f41a5cda700 1 Processor -- start 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.100+0000 7f41a5cda700 1 -- start start 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f41a5cda700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 0x7f41a00c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f41a5cda700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00cd530 0x7f41a015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f41a5cda700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a01591d0 0x7f41a00b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f41a5cda700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00b2620 con 0x7f41a00cd530 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f41a5cda700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00b1d80 con 0x7f41a00c9c10 2023-06-09T04:37:54.105 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f41a5cda700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00b4a90 con 0x7f41a01591d0 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 0x7f41a00c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 0x7f41a00c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48858/0 (socket says 172.21.15.104:48858) 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 -- 172.21.15.104:0/971283917 learned_addr learned my addr 172.21.15.104:0/971283917 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419ffff700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a01591d0 0x7f41a00b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419effd700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00cd530 0x7f41a015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 -- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a01591d0 msgr2=0x7f41a00b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a01591d0 0x7f41a00b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 -- 172.21.15.104:0/971283917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00cd530 msgr2=0x7f41a015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00cd530 0x7f41a015ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419f7fe700 1 -- 172.21.15.104:0/971283917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194009550 con 0x7f41a00c9c10 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.101+0000 7f419ffff700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a01591d0 0x7f41a00b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.102+0000 7f419f7fe700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 0x7f41a00c6360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f419000e8a0 tx=0x7f419000ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.102+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190009590 con 0x7f41a00c9c10 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.102+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190013680 con 0x7f41a00c9c10 2023-06-09T04:37:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.102+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a00b1fd0 con 0x7f41a00c9c10 2023-06-09T04:37:54.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.102+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900139f0 con 0x7f41a00c9c10 2023-06-09T04:37:54.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.102+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a015cf40 con 0x7f41a00c9c10 2023-06-09T04:37:54.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.103+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4190005a20 con 0x7f41a00c9c10 2023-06-09T04:37:54.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.103+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4190006660 con 0x7f41a00c9c10 2023-06-09T04:37:54.108 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.103+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a0067180 con 0x7f41a00c9c10 2023-06-09T04:37:54.109 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.105+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4190021060 con 0x7f41a00c9c10 2023-06-09T04:37:54.197 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.197+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6269c0a7-b639-4d47-b782-365766e42068", "id": 5} v 0) v1 -- 0x7f41a015ab20 con 0x7f41a00c9c10 2023-06-09T04:37:54.200 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.200+0000 7f4187fff700 1 -- 172.21.15.104:0/971283917 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6269c0a7-b639-4d47-b782-365766e42068", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4190017070 con 0x7f41a00c9c10 2023-06-09T04:37:54.201 INFO:teuthology.orchestra.run.smithi104.stdout:5 2023-06-09T04:37:54.201 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 msgr2=0x7f41a00c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 0x7f41a00c6360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f419000e8a0 tx=0x7f419000ebb0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 shutdown_connections 2023-06-09T04:37:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41a01591d0 0x7f41a00b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a00c9c10 0x7f41a00c6360 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 --2- 172.21.15.104:0/971283917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00cd530 0x7f41a015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 >> 172.21.15.104:0/971283917 conn(0x7f41a00cb9d0 msgr2=0x7f41a006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 shutdown_connections 2023-06-09T04:37:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.201+0000 7f41a5cda700 1 -- 172.21.15.104:0/971283917 wait complete. 2023-06-09T04:37:54.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 29628cc4-8756-4c1f-8af8-108fcd116943 6 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.357+0000 7f9c14fd5700 1 Processor -- start 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.357+0000 7f9c14fd5700 1 -- start start 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.358+0000 7f9c14fd5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c1006a4c0 0x7f9c1006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.358+0000 7f9c14fd5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100707f0 con 0x7f9c100702c0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.358+0000 7f9c14fd5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c10070ad0 con 0x7f9c100cc860 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.358+0000 7f9c14fd5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10169690 con 0x7f9c1006a4c0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.359+0000 7f9c0e59c700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9c100cc860 0x7f9c10069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42194/0 (socket says 172.21.15.104:42194) 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.359+0000 7f9c0e59c700 1 -- 172.21.15.104:0/2878393363 learned_addr learned my addr 172.21.15.104:0/2878393363 (peer_addr_for_me v1:172.21.15.104:0/0) 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.359+0000 7f9c0dd9b700 1 --2- 172.21.15.104:0/2878393363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c1006a4c0 0x7f9c1006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.359+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405097890 0 0) 0x7f9c10070ad0 con 0x7f9c100cc860 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf8003590 con 0x7f9c100cc860 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522941899 0 0) 0x7f9c100707f0 con 0x7f9c100702c0 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c10070ad0 con 0x7f9c100702c0 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0dd9b700 1 -- 172.21.15.104:0/2878393363 >> v1:172.21.15.104:6789/0 conn(0x7f9c100cc860 legacy=0x7f9c10069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0dd9b700 1 -- 172.21.15.104:0/2878393363 >> v1:172.21.15.26:6789/0 conn(0x7f9c100702c0 legacy=0x7f9c1006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0dd9b700 1 -- 172.21.15.104:0/2878393363 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10070db0 con 0x7f9c1006a4c0 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0dd9b700 1 --2- 172.21.15.104:0/2878393363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c1006a4c0 0x7f9c1006c6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007170 tx=0x7f9c04007480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5daac553768fd11 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400e070 con 0x7f9c1006a4c0 2023-06-09T04:37:54.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04007a90 con 0x7f9c1006a4c0 2023-06-09T04:37:54.367 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.363+0000 7f9c0d59a700 1 -- 172.21.15.104:0/2878393363 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04007e40 con 0x7f9c1006a4c0 2023-06-09T04:37:54.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 -- 172.21.15.104:0/2878393363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c1006a4c0 msgr2=0x7f9c1006c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 --2- 172.21.15.104:0/2878393363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c1006a4c0 0x7f9c1006c6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007170 tx=0x7f9c04007480 comp rx=0 tx=0).stop 2023-06-09T04:37:54.369 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 -- 172.21.15.104:0/2878393363 shutdown_connections 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 --2- 172.21.15.104:0/2878393363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c1006a4c0 0x7f9c1006c6e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 -- 172.21.15.104:0/2878393363 >> 172.21.15.104:0/2878393363 conn(0x7f9c100b0f20 msgr2=0x7f9c100ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 -- 172.21.15.104:0/2878393363 shutdown_connections 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.364+0000 7f9c14fd5700 1 -- 172.21.15.104:0/2878393363 wait complete. 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.365+0000 7f9c14fd5700 1 Processor -- start 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.365+0000 7f9c14fd5700 1 -- start start 2023-06-09T04:37:54.370 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c14fd5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1006a4c0 0x7f9c1007f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c14fd5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c100702c0 0x7f9c100aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c14fd5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 0x7f9c100aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c14fd5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100a7a50 con 0x7f9c1006a4c0 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c14fd5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100a85d0 con 0x7f9c100cc860 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c14fd5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100a7ca0 con 0x7f9c100702c0 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 0x7f9c100aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c0dd9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c100702c0 0x7f9c100aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 0x7f9c100aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48872/0 (socket says 172.21.15.104:48872) 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c0ed9d700 1 -- 172.21.15.104:0/401245015 learned_addr learned my addr 172.21.15.104:0/401245015 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.366+0000 7f9c0e59c700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1006a4c0 0x7f9c1007f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0dd9b700 1 -- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 msgr2=0x7f9c100aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0dd9b700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 0x7f9c100aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0dd9b700 1 -- 172.21.15.104:0/401245015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1006a4c0 msgr2=0x7f9c1007f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0dd9b700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1006a4c0 0x7f9c1007f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0dd9b700 1 -- 172.21.15.104:0/401245015 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009dc0 con 0x7f9c100702c0 2023-06-09T04:37:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0ed9d700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 0x7f9c100aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c0dd9b700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c100702c0 0x7f9c100aa290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c04015000 tx=0x7f9c04004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04013c90 con 0x7f9c100702c0 2023-06-09T04:37:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04013df0 con 0x7f9c100702c0 2023-06-09T04:37:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c100a7f80 con 0x7f9c100702c0 2023-06-09T04:37:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0401c660 con 0x7f9c100702c0 2023-06-09T04:37:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c101feeb0 con 0x7f9c100702c0 2023-06-09T04:37:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9c0401cac0 con 0x7f9c100702c0 2023-06-09T04:37:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.367+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9c0401b3a0 con 0x7f9c100702c0 2023-06-09T04:37:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.368+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c101ff040 con 0x7f9c100702c0 2023-06-09T04:37:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.370+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9c04022070 con 0x7f9c100702c0 2023-06-09T04:37:54.453 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.453+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd new", "uuid": "29628cc4-8756-4c1f-8af8-108fcd116943", "id": 6} v 0) v1 -- 0x7f9c10074080 con 0x7f9c100702c0 2023-06-09T04:37:54.465 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.465+0000 7f9bfeffd700 1 -- 172.21.15.104:0/401245015 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29628cc4-8756-4c1f-8af8-108fcd116943", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c04027450 con 0x7f9c100702c0 2023-06-09T04:37:54.465 INFO:teuthology.orchestra.run.smithi104.stdout:6 2023-06-09T04:37:54.466 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c100702c0 msgr2=0x7f9c100aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c100702c0 0x7f9c100aa290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c04015000 tx=0x7f9c04004750 comp rx=0 tx=0).stop 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 shutdown_connections 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c100cc860 0x7f9c100aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c1006a4c0 0x7f9c1007f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 --2- 172.21.15.104:0/401245015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9c100702c0 0x7f9c100aa290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 >> 172.21.15.104:0/401245015 conn(0x7f9c100b0f20 msgr2=0x7f9c1006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 shutdown_connections 2023-06-09T04:37:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.466+0000 7f9c14fd5700 1 -- 172.21.15.104:0/401245015 wait complete. 2023-06-09T04:37:54.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 6f416d08-ee4f-475f-8d3a-1d26b0efac99 7 2023-06-09T04:37:54.483 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:54.483+0000 7efe533f3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-09T04:37:54.492 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:54.491+0000 7ff0f98e7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-09T04:37:54.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.600+0000 7fb644f5e700 1 Processor -- start 2023-06-09T04:37:54.601 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.600+0000 7fb644f5e700 1 -- start start 2023-06-09T04:37:54.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb644f5e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb64006ea70 0x7fb640163f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb644f5e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb640159880 con 0x7fb6400aed90 2023-06-09T04:37:54.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb644f5e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64006cff0 con 0x7fb6400ca540 2023-06-09T04:37:54.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb644f5e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400cda30 con 0x7fb64006ea70 2023-06-09T04:37:54.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb63dd9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb6400ca540 0x7fb6400ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42204/0 (socket says 172.21.15.104:42204) 2023-06-09T04:37:54.602 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb63ed9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb64006ea70 0x7fb640163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.603 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.601+0000 7fb63dd9b700 1 -- 172.21.15.104:0/153350163 learned_addr learned my addr 172.21.15.104:0/153350163 (peer_addr_for_me v1:172.21.15.104:0/0) 2023-06-09T04:37:54.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63ed9d700 1 -- 172.21.15.104:0/153350163 >> v1:172.21.15.104:6789/0 conn(0x7fb6400ca540 legacy=0x7fb6400ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63ed9d700 1 -- 172.21.15.104:0/153350163 >> v1:172.21.15.26:6789/0 conn(0x7fb6400aed90 legacy=0x7fb6400c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63d59a700 1 -- 172.21.15.104:0/153350163 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941054100 0 0) 0x7fb64006cff0 con 0x7fb6400ca540 2023-06-09T04:37:54.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63ed9d700 1 -- 172.21.15.104:0/153350163 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400cf250 con 0x7fb64006ea70 2023-06-09T04:37:54.604 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63ed9d700 1 --2- 172.21.15.104:0/153350163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64006ea70 0x7fb640163f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb638009d90 tx=0x7fb63800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb8c2156cb97be1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63d59a700 1 -- 172.21.15.104:0/153350163 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800e070 con 0x7fb64006ea70 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63d59a700 1 -- 172.21.15.104:0/153350163 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800bad0 con 0x7fb64006ea70 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.602+0000 7fb63d59a700 1 -- 172.21.15.104:0/153350163 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800be80 con 0x7fb64006ea70 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 -- 172.21.15.104:0/153350163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64006ea70 msgr2=0x7fb640163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 --2- 172.21.15.104:0/153350163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64006ea70 0x7fb640163f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb638009d90 tx=0x7fb63800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 -- 172.21.15.104:0/153350163 shutdown_connections 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 --2- 172.21.15.104:0/153350163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64006ea70 0x7fb640163f90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.605 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 -- 172.21.15.104:0/153350163 >> 172.21.15.104:0/153350163 conn(0x7fb640098a30 msgr2=0x7fb6400cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 -- 172.21.15.104:0/153350163 shutdown_connections 2023-06-09T04:37:54.606 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.603+0000 7fb644f5e700 1 -- 172.21.15.104:0/153350163 wait complete. 2023-06-09T04:37:54.607 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.604+0000 7fb644f5e700 1 Processor -- start 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.604+0000 7fb644f5e700 1 -- start start 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb644f5e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 0x7fb6400b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb644f5e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 0x7fb6400b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb644f5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400ca540 0x7fb640149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb644f5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400b3fb0 con 0x7fb6400ca540 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb644f5e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400b4290 con 0x7fb6400aed90 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb644f5e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400b4570 con 0x7fb64006ea70 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63dd9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 0x7fb6400b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 0x7fb6400b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63dd9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 0x7fb6400b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48882/0 (socket says 172.21.15.104:48882) 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 0x7fb6400b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:40830/0 (socket says 172.21.15.104:40830) 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63dd9b700 1 -- 172.21.15.104:0/3744784899 learned_addr learned my addr 172.21.15.104:0/3744784899 (peer_addr_for_me v2:172.21.15.104:0/0) 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63ed9d700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400ca540 0x7fb640149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.609 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 -- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 msgr2=0x7fb6400b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 0x7fb6400b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 -- 172.21.15.104:0/3744784899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400ca540 msgr2=0x7fb640149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400ca540 0x7fb640149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63e59c700 1 -- 172.21.15.104:0/3744784899 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb638009a70 con 0x7fb64006ea70 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.605+0000 7fb63dd9b700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 0x7fb6400b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb63e59c700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 0x7fb6400b5050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c4a0 tx=0x7fb63000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300054e0 con 0x7fb64006ea70 2023-06-09T04:37:54.610 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6300036d0 con 0x7fb64006ea70 2023-06-09T04:37:54.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400b4850 con 0x7fb64006ea70 2023-06-09T04:37:54.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630003a80 con 0x7fb64006ea70 2023-06-09T04:37:54.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400b35d0 con 0x7fb64006ea70 2023-06-09T04:37:54.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb63001c440 con 0x7fb64006ea70 2023-06-09T04:37:54.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.606+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb630012a60 con 0x7fb64006ea70 2023-06-09T04:37:54.611 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.607+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb640070ba0 con 0x7fb64006ea70 2023-06-09T04:37:54.612 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.609+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb630017070 con 0x7fb64006ea70 2023-06-09T04:37:54.645 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:54.645+0000 7efe533f3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:37:54.653 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:54.653+0000 7ff0f98e7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.692+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6f416d08-ee4f-475f-8d3a-1d26b0efac99", "id": 7} v 0) v1 -- 0x7fb640067180 con 0x7fb64006ea70 2023-06-09T04:37:54.700 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.700+0000 7fb62effd700 1 -- 172.21.15.104:0/3744784899 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f416d08-ee4f-475f-8d3a-1d26b0efac99", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb630012400 con 0x7fb64006ea70 2023-06-09T04:37:54.701 INFO:teuthology.orchestra.run.smithi104.stdout:7 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 msgr2=0x7fb6400b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 0x7fb6400b5050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c4a0 tx=0x7fb63000c7b0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 shutdown_connections 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6400ca540 0x7fb640149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb64006ea70 0x7fb6400b5050 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 --2- 172.21.15.104:0/3744784899 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6400aed90 0x7fb6400b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.702 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 >> 172.21.15.104:0/3744784899 conn(0x7fb640098a30 msgr2=0x7fb6400ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 shutdown_connections 2023-06-09T04:37:54.703 INFO:teuthology.orchestra.run.smithi104.stderr:2023-06-09T04:37:54.701+0000 7fb644f5e700 1 -- 172.21.15.104:0/3744784899 wait complete. 2023-06-09T04:37:54.713 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-09T04:37:54.713 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-09T04:37:54.715 INFO:tasks.ceph.osd.0:Started 2023-06-09T04:37:54.715 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-09T04:37:54.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-09T04:37:54.718 INFO:tasks.ceph.osd.1:Started 2023-06-09T04:37:54.718 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-09T04:37:54.718 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-09T04:37:54.720 INFO:tasks.ceph.osd.2:Started 2023-06-09T04:37:54.720 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-09T04:37:54.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-09T04:37:54.722 INFO:tasks.ceph.osd.3:Started 2023-06-09T04:37:54.722 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-09T04:37:54.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-09T04:37:54.755 INFO:tasks.ceph.osd.4:Started 2023-06-09T04:37:54.755 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-09T04:37:54.755 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-09T04:37:54.757 INFO:tasks.ceph.osd.5:Started 2023-06-09T04:37:54.757 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-09T04:37:54.758 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-09T04:37:54.759 INFO:tasks.ceph.osd.6:Started 2023-06-09T04:37:54.760 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-09T04:37:54.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-09T04:37:54.762 INFO:tasks.ceph.osd.7:Started 2023-06-09T04:37:54.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:54.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.912+0000 7f0db856c700 1 Processor -- start 2023-06-09T04:37:54.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.912+0000 7f0db856c700 1 -- start start 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db856c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00d0e50 0x7f0db0160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db856c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00cce70 con 0x7f0db015c550 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db856c700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db0160790 con 0x7f0db00cc620 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db856c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0161030 con 0x7f0db00d0e50 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db6308700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0db015c550 0x7f0db00caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46018/0 (socket says 172.21.15.26:46018) 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db6308700 1 -- 172.21.15.26:0/2243917342 learned_addr learned my addr 172.21.15.26:0/2243917342 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:37:54.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db6b09700 1 --2- 172.21.15.26:0/2243917342 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00d0e50 0x7f0db0160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546741669 0 0) 0x7f0db00cce70 con 0x7f0db015c550 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c0035b0 con 0x7f0db015c550 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412070623 0 0) 0x7f0db0160790 con 0x7f0db00cc620 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db00cce70 con 0x7f0db00cc620 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db6b09700 1 -- 172.21.15.26:0/2243917342 >> v1:172.21.15.104:6789/0 conn(0x7f0db00cc620 legacy=0x7f0db00d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db6b09700 1 -- 172.21.15.26:0/2243917342 >> v1:172.21.15.26:6789/0 conn(0x7f0db015c550 legacy=0x7f0db00caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.913+0000 7f0db6b09700 1 -- 172.21.15.26:0/2243917342 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0160a70 con 0x7f0db00d0e50 2023-06-09T04:37:54.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db6b09700 1 --2- 172.21.15.26:0/2243917342 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00d0e50 0x7f0db0160100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009dc0 tx=0x7f0da800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a921c77b30a63d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800e070 con 0x7f0db00d0e50 2023-06-09T04:37:54.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da800bb20 con 0x7f0db00d0e50 2023-06-09T04:37:54.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db5306700 1 -- 172.21.15.26:0/2243917342 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8012430 con 0x7f0db00d0e50 2023-06-09T04:37:54.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 -- 172.21.15.26:0/2243917342 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00d0e50 msgr2=0x7f0db0160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 --2- 172.21.15.26:0/2243917342 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00d0e50 0x7f0db0160100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009dc0 tx=0x7f0da800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:54.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 -- 172.21.15.26:0/2243917342 shutdown_connections 2023-06-09T04:37:54.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 --2- 172.21.15.26:0/2243917342 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00d0e50 0x7f0db0160100 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 -- 172.21.15.26:0/2243917342 >> 172.21.15.26:0/2243917342 conn(0x7f0db0089fc0 msgr2=0x7f0db008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 -- 172.21.15.26:0/2243917342 shutdown_connections 2023-06-09T04:37:54.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.914+0000 7f0db856c700 1 -- 172.21.15.26:0/2243917342 wait complete. 2023-06-09T04:37:54.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.916+0000 7f0db856c700 1 Processor -- start 2023-06-09T04:37:54.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.916+0000 7f0db856c700 1 -- start start 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00cc620 0x7f0db0147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db00d0e50 0x7f0db014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 0x7f0db006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00afdb0 con 0x7f0db015c550 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db014ace0 con 0x7f0db00d0e50 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00af130 con 0x7f0db00cc620 2023-06-09T04:37:54.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 0x7f0db006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 0x7f0db006efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37168/0 (socket says 172.21.15.26:37168) 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 -- 172.21.15.26:0/1963050460 learned_addr learned my addr 172.21.15.26:0/1963050460 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6308700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00cc620 0x7f0db0147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db5b07700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db00d0e50 0x7f0db014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 -- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00cc620 msgr2=0x7f0db0147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00cc620 0x7f0db0147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 -- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db00d0e50 msgr2=0x7f0db014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db00d0e50 0x7f0db014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 -- 172.21.15.26:0/1963050460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8009a70 con 0x7f0db015c550 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db6b09700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 0x7f0db006efd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0db006de40 tx=0x7f0da8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8012430 con 0x7f0db015c550 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8020070 con 0x7f0db015c550 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.918+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db00af410 con 0x7f0db015c550 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.919+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da801ba90 con 0x7f0db015c550 2023-06-09T04:37:54.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.919+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db00af9d0 con 0x7f0db015c550 2023-06-09T04:37:54.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.919+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0da8027480 con 0x7f0db015c550 2023-06-09T04:37:54.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.919+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0da8022070 con 0x7f0db015c550 2023-06-09T04:37:54.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.920+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db00afef0 con 0x7f0db015c550 2023-06-09T04:37:54.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:54.922+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0da8046b00 con 0x7f0db015c550 2023-06-09T04:37:55.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.005+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0db00afb60 con 0x7f0db015c550 2023-06-09T04:37:55.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.005+0000 7f0da6ffd700 1 -- 172.21.15.26:0/1963050460 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0da8035030 con 0x7f0db015c550 2023-06-09T04:37:55.006 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:37:55.007 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:37:54.693799+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:55.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 msgr2=0x7f0db006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 0x7f0db006efd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0db006de40 tx=0x7f0da8004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 shutdown_connections 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0db015c550 0x7f0db006efd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0db00cc620 0x7f0db0147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 --2- 172.21.15.26:0/1963050460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db00d0e50 0x7f0db014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 >> 172.21.15.26:0/1963050460 conn(0x7f0db0089fc0 msgr2=0x7f0db015bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 shutdown_connections 2023-06-09T04:37:55.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:37:55.006+0000 7f0db856c700 1 -- 172.21.15.26:0/1963050460 wait complete. 2023-06-09T04:37:55.019 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-09T04:37:55.020 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-09T04:37:55.101 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-06-09T04:37:55.100+0000 7f6823ba2640 -1 Falling back to public interface 2023-06-09T04:37:55.345 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-06-09T04:37:55.344+0000 7f0e1b52e640 -1 Falling back to public interface 2023-06-09T04:37:55.353 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-06-09T04:37:55.352+0000 7f8ed12af640 -1 Falling back to public interface 2023-06-09T04:37:55.359 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-06-09T04:37:55.359+0000 7fa5265ed640 -1 Falling back to public interface 2023-06-09T04:37:55.364 INFO:tasks.ceph.osd.7.smithi104.stderr:2023-06-09T04:37:55.364+0000 7f878a584640 -1 Falling back to public interface 2023-06-09T04:37:55.368 INFO:tasks.ceph.osd.4.smithi104.stderr:2023-06-09T04:37:55.368+0000 7f6d940b1640 -1 Falling back to public interface 2023-06-09T04:37:55.369 INFO:tasks.ceph.osd.6.smithi104.stderr:2023-06-09T04:37:55.368+0000 7fee0c5cf640 -1 Falling back to public interface 2023-06-09T04:37:55.378 INFO:tasks.ceph.osd.5.smithi104.stderr:2023-06-09T04:37:55.378+0000 7fa780575640 -1 Falling back to public interface 2023-06-09T04:37:55.380 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:55.380+0000 7efe533f3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:55.429 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:55.429+0000 7ff0f98e7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:55.458 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:55.458+0000 7efe533f3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:37:55.511 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:55.510+0000 7ff0f98e7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:37:55.595 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:55.595+0000 7efe533f3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:55.656 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:55.655+0000 7ff0f98e7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:55.824 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:55.830 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:55.830+0000 7efe533f3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-09T04:37:55.903 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:55.902+0000 7efe533f3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:37:55.903 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:55.902+0000 7ff0f98e7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-09T04:37:55.939 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.939+0000 7f500b768700 1 Processor -- start 2023-06-09T04:37:55.940 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.939+0000 7f500b768700 1 -- start start 2023-06-09T04:37:55.941 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f500b768700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f500406a4c0 0x7f500415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.941 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f500b768700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f5004071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.941 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f500b768700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5004071850 con 0x7f500415a100 2023-06-09T04:37:55.941 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f500b768700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040d0390 con 0x7f500406a4c0 2023-06-09T04:37:55.941 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f500b768700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50040c9f90 con 0x7f5004071440 2023-06-09T04:37:55.941 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5009d05700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f5004071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.942 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5008d03700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f500406a4c0 0x7f500415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.942 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5009504700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f500415a100 0x7f5004069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:44940/0 (socket says 172.21.15.26:44940) 2023-06-09T04:37:55.942 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5009504700 1 -- 172.21.15.26:0/405118921 learned_addr learned my addr 172.21.15.26:0/405118921 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:37:55.943 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f4ffbfff700 1 -- 172.21.15.26:0/405118921 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464441326 0 0) 0x7f5004071850 con 0x7f500415a100 2023-06-09T04:37:55.943 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f4ffbfff700 1 -- 172.21.15.26:0/405118921 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff00035b0 con 0x7f500415a100 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5008d03700 1 -- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 msgr2=0x7f5004071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5008d03700 1 --2- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f5004071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5008d03700 1 -- 172.21.15.26:0/405118921 >> v1:172.21.15.104:6789/0 conn(0x7f500415a100 legacy=0x7f5004069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5008d03700 1 -- 172.21.15.26:0/405118921 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040ca270 con 0x7f500406a4c0 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5009d05700 1 --2- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f5004071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.940+0000 7f5008d03700 1 --2- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500406a4c0 0x7f500415a4d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009840 tx=0x7f4ff4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fdb759ca29fc920 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.944 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f4ffbfff700 1 -- 172.21.15.26:0/405118921 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011830 con 0x7f500406a4c0 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f4ffbfff700 1 -- 172.21.15.26:0/405118921 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4011990 con 0x7f500406a4c0 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f4ffbfff700 1 -- 172.21.15.26:0/405118921 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011d20 con 0x7f500406a4c0 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 -- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500406a4c0 msgr2=0x7f500415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 --2- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500406a4c0 0x7f500415a4d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009840 tx=0x7f4ff4009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 -- 172.21.15.26:0/405118921 shutdown_connections 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 --2- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f5004071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.945 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 --2- 172.21.15.26:0/405118921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500406a4c0 0x7f500415a4d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.946 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 -- 172.21.15.26:0/405118921 >> 172.21.15.26:0/405118921 conn(0x7f500406fc00 msgr2=0x7f50040b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.946 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 -- 172.21.15.26:0/405118921 shutdown_connections 2023-06-09T04:37:55.946 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.941+0000 7f500b768700 1 -- 172.21.15.26:0/405118921 wait complete. 2023-06-09T04:37:55.946 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.942+0000 7f500b768700 1 Processor -- start 2023-06-09T04:37:55.946 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.942+0000 7f500b768700 1 -- start start 2023-06-09T04:37:55.948 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f500b768700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 0x7f50041efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.948 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f500b768700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f50040b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.948 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f500b768700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500415a100 0x7f50040b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.948 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f500b768700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50040c63c0 con 0x7f500406a4c0 2023-06-09T04:37:55.948 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f500b768700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004155fd0 con 0x7f500415a100 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f500b768700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50041562b0 con 0x7f5004071440 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f5009504700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 0x7f50041efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f5009504700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 0x7f50041efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37176/0 (socket says 172.21.15.26:37176) 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f5009504700 1 -- 172.21.15.26:0/110558054 learned_addr learned my addr 172.21.15.26:0/110558054 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f5008d03700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f50040b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.943+0000 7f5009d05700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500415a100 0x7f50040b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009d05700 1 -- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 msgr2=0x7f50040b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.949 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009d05700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f50040b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009d05700 1 -- 172.21.15.26:0/110558054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 msgr2=0x7f50041efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009d05700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 0x7f50041efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009d05700 1 -- 172.21.15.26:0/110558054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009a70 con 0x7f500415a100 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5008d03700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f50040b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009504700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 0x7f50041efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f5009d05700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500415a100 0x7f50040b3c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00efc0 tx=0x7f4ffc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.950 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00ca90 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00f040 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff40094a0 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00ce30 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ffc003d20 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004156870 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.944+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4ffc0144d0 con 0x7f500415a100 2023-06-09T04:37:55.951 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.945+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5004156a60 con 0x7f500415a100 2023-06-09T04:37:55.952 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:55.947+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4ffc018030 con 0x7f500415a100 2023-06-09T04:37:55.982 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:55.982+0000 7ff0f98e7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:37:56.020 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.019+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5004074080 con 0x7f500415a100 2023-06-09T04:37:56.021 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.020+0000 7f4ff9ffb700 1 -- 172.21.15.26:0/110558054 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4ffc0042d0 con 0x7f500415a100 2023-06-09T04:37:56.021 INFO:teuthology.misc.health.smithi026.stdout: 2023-06-09T04:37:56.021 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:37:54.693799+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:56.022 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500415a100 msgr2=0x7f50040b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.022 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500415a100 0x7f50040b3c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00efc0 tx=0x7f4ffc00c3a0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.022 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 shutdown_connections 2023-06-09T04:37:56.023 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f500415a100 0x7f50040b3c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.023 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f500406a4c0 0x7f50041efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.023 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 --2- 172.21.15.26:0/110558054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5004071440 0x7f50040b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.023 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 >> 172.21.15.26:0/110558054 conn(0x7f500406fc00 msgr2=0x7f50040cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.023 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 shutdown_connections 2023-06-09T04:37:56.023 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:37:56.021+0000 7f500b768700 1 -- 172.21.15.26:0/110558054 wait complete. 2023-06-09T04:37:56.033 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:37:56.173 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:56.173+0000 7efe533f3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:37:56.266 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:56.265+0000 7ff0f98e7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:37:56.389 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:56.389+0000 7efe533f3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:37:56.493 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:56.492+0000 7ff0f98e7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:37:56.545 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:56.545+0000 7efe533f3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:37:56.656 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:56.655+0000 7ff0f98e7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:37:56.658 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:56.658+0000 7efe533f3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:37:56.776 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:56.775+0000 7ff0f98e7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:37:56.977 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:56.977+0000 7efe533f3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:37:57.078 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:57.078+0000 7efe533f3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:57.111 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:57.110+0000 7ff0f98e7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:37:57.215 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:57.214+0000 7ff0f98e7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:57.261 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:57.261+0000 7efe533f3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:37:57.406 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:57.405+0000 7ff0f98e7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:37:57.853 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:57.848+0000 7efe533f3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:37:58.056 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-06-09T04:37:58.055+0000 7ff0f98e7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:37:58.643 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-06-09T04:37:58.642+0000 7f6823ba2640 -1 osd.1 0 log_to_monitors true 2023-06-09T04:37:58.874 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:58.874+0000 7efe0b61f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-09T04:37:58.875 INFO:tasks.ceph.mgr.x.smithi104.stderr:2023-06-09T04:37:58.874+0000 7efe0b61f700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-09T04:37:58.886 INFO:tasks.ceph.osd.7.smithi104.stderr:2023-06-09T04:37:58.886+0000 7f878a584640 -1 osd.7 0 log_to_monitors true 2023-06-09T04:37:58.890 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-06-09T04:37:58.890+0000 7fa5265ed640 -1 osd.3 0 log_to_monitors true 2023-06-09T04:37:58.906 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-06-09T04:37:58.905+0000 7f8ed12af640 -1 osd.2 0 log_to_monitors true 2023-06-09T04:37:58.917 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-06-09T04:37:58.916+0000 7f0e1b52e640 -1 osd.0 0 log_to_monitors true 2023-06-09T04:37:58.920 INFO:tasks.ceph.osd.4.smithi104.stderr:2023-06-09T04:37:58.920+0000 7f6d940b1640 -1 osd.4 0 log_to_monitors true 2023-06-09T04:37:58.921 INFO:tasks.ceph.osd.6.smithi104.stderr:2023-06-09T04:37:58.920+0000 7fee0c5cf640 -1 osd.6 0 log_to_monitors true 2023-06-09T04:37:58.928 INFO:tasks.ceph.osd.5.smithi104.stderr:2023-06-09T04:37:58.928+0000 7fa780575640 -1 osd.5 0 log_to_monitors true 2023-06-09T04:38:01.315 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-06-09T04:38:01.314+0000 7f6817759700 -1 osd.1 0 waiting for initial osdmap 2023-06-09T04:38:01.329 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-06-09T04:38:01.328+0000 7f680fb34700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:01.391 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-06-09T04:38:01.390+0000 7f0e0f0e5700 -1 osd.0 0 waiting for initial osdmap 2023-06-09T04:38:01.392 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-06-09T04:38:01.391+0000 7fa51a1a4700 -1 osd.3 0 waiting for initial osdmap 2023-06-09T04:38:01.399 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-06-09T04:38:01.399+0000 7f0e074c0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:01.404 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-06-09T04:38:01.404+0000 7fa51257f700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:01.411 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-06-09T04:38:01.411+0000 7f8ec4e66700 -1 osd.2 0 waiting for initial osdmap 2023-06-09T04:38:01.425 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-06-09T04:38:01.424+0000 7f8ebd241700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:02.104 INFO:tasks.ceph.osd.4.smithi104.stderr:2023-06-09T04:38:02.101+0000 7f6d87c68700 -1 osd.4 0 waiting for initial osdmap 2023-06-09T04:38:02.114 INFO:tasks.ceph.osd.4.smithi104.stderr:2023-06-09T04:38:02.114+0000 7f6d80043700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:02.120 INFO:tasks.ceph.osd.7.smithi104.stderr:2023-06-09T04:38:02.120+0000 7f877e13b700 -1 osd.7 0 waiting for initial osdmap 2023-06-09T04:38:02.134 INFO:tasks.ceph.osd.6.smithi104.stderr:2023-06-09T04:38:02.134+0000 7fee00186700 -1 osd.6 0 waiting for initial osdmap 2023-06-09T04:38:02.135 INFO:tasks.ceph.osd.7.smithi104.stderr:2023-06-09T04:38:02.135+0000 7f8776516700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:02.143 INFO:tasks.ceph.osd.5.smithi104.stderr:2023-06-09T04:38:02.143+0000 7fa77412c700 -1 osd.5 0 waiting for initial osdmap 2023-06-09T04:38:02.149 INFO:tasks.ceph.osd.6.smithi104.stderr:2023-06-09T04:38:02.149+0000 7fedf8561700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:02.161 INFO:tasks.ceph.osd.5.smithi104.stderr:2023-06-09T04:38:02.161+0000 7fa76c507700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:38:02.837 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:02.965 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.964+0000 7fe10a7d1700 1 Processor -- start 2023-06-09T04:38:02.966 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.964+0000 7fe10a7d1700 1 -- start start 2023-06-09T04:38:02.967 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe10a7d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1040cfec0 0x7fe10415a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.967 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe10a7d1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040cdd00 con 0x7fe1040b1eb0 2023-06-09T04:38:02.967 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe10a7d1700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040cdfe0 con 0x7fe104159200 2023-06-09T04:38:02.967 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe10a7d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe104159770 con 0x7fe1040cfec0 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe108d6e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1040cfec0 0x7fe10415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe1037fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe1040b1eb0 0x7fe1040cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46162/0 (socket says 172.21.15.26:46162) 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.965+0000 7fe1037fe700 1 -- 172.21.15.26:0/238544813 learned_addr learned my addr 172.21.15.26:0/238544813 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe108d6e700 1 -- 172.21.15.26:0/238544813 >> v1:172.21.15.104:6789/0 conn(0x7fe104159200 legacy=0x7fe1040cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe108d6e700 1 -- 172.21.15.26:0/238544813 >> v1:172.21.15.26:6789/0 conn(0x7fe1040b1eb0 legacy=0x7fe1040cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe108d6e700 1 -- 172.21.15.26:0/238544813 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104159a50 con 0x7fe1040cfec0 2023-06-09T04:38:02.968 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe102ffd700 1 -- 172.21.15.26:0/238544813 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529827731 0 0) 0x7fe1040cdd00 con 0x7fe1040b1eb0 2023-06-09T04:38:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe108d6e700 1 --2- 172.21.15.26:0/238544813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040cfec0 0x7fe10415a250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009dc0 tx=0x7fe0fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb36832b02e43c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe102ffd700 1 -- 172.21.15.26:0/238544813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00e070 con 0x7fe1040cfec0 2023-06-09T04:38:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe102ffd700 1 -- 172.21.15.26:0/238544813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00bb50 con 0x7fe1040cfec0 2023-06-09T04:38:02.969 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.966+0000 7fe102ffd700 1 -- 172.21.15.26:0/238544813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc003a20 con 0x7fe1040cfec0 2023-06-09T04:38:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 -- 172.21.15.26:0/238544813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040cfec0 msgr2=0x7fe10415a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/238544813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040cfec0 0x7fe10415a250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009dc0 tx=0x7fe0fc00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 -- 172.21.15.26:0/238544813 shutdown_connections 2023-06-09T04:38:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/238544813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040cfec0 0x7fe10415a250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.971 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 -- 172.21.15.26:0/238544813 >> 172.21.15.26:0/238544813 conn(0x7fe10406fc00 msgr2=0x7fe1040b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 -- 172.21.15.26:0/238544813 shutdown_connections 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.967+0000 7fe10a7d1700 1 -- 172.21.15.26:0/238544813 wait complete. 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.968+0000 7fe10a7d1700 1 Processor -- start 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.968+0000 7fe10a7d1700 1 -- start start 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe10a7d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 0x7fe104152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe10a7d1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe1040cfec0 0x7fe1041e3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.972 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe10a7d1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe104159200 0x7fe1041e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe10a7d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040b44e0 con 0x7fe1040b1eb0 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe10a7d1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c9a40 con 0x7fe104159200 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe10a7d1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040b46c0 con 0x7fe1040cfec0 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 0x7fe104152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 0x7fe104152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37310/0 (socket says 172.21.15.26:37310) 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 -- 172.21.15.26:0/1613161846 learned_addr learned my addr 172.21.15.26:0/1613161846 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe1037fe700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe1040cfec0 0x7fe1041e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.973 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe108d6e700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe104159200 0x7fe1041e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 -- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe1040cfec0 msgr2=0x7fe1041e3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe1040cfec0 0x7fe1041e3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 -- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe104159200 msgr2=0x7fe1041e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe104159200 0x7fe1041e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe103fff700 1 -- 172.21.15.26:0/1613161846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009a70 con 0x7fe1040b1eb0 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.969+0000 7fe1037fe700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe1040cfec0 0x7fe1041e3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:02.974 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.970+0000 7fe103fff700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 0x7fe104152e70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00b4a0 tx=0x7fe0ec00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:02.975 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.970+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec011830 con 0x7fe1040b1eb0 2023-06-09T04:38:02.975 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.970+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec011990 con 0x7fe1040b1eb0 2023-06-09T04:38:02.975 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.970+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec011d40 con 0x7fe1040b1eb0 2023-06-09T04:38:02.975 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.970+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1040b49a0 con 0x7fe1040b1eb0 2023-06-09T04:38:02.975 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.970+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1040b4f60 con 0x7fe1040b1eb0 2023-06-09T04:38:02.976 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.971+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10406be50 con 0x7fe1040b1eb0 2023-06-09T04:38:02.976 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.971+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fe0ec01a400 con 0x7fe1040b1eb0 2023-06-09T04:38:02.976 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.972+0000 7fe100ff9700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe0e406ac80 0x7fe0e406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.976 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.972+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3351+0+0 (secure 0 0 0) 0x7fe0ec0886d0 con 0x7fe1040b1eb0 2023-06-09T04:38:02.976 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.972+0000 7fe1037fe700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe0e406ac80 0x7fe0e406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.977 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.972+0000 7fe1037fe700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe0e406ac80 0x7fe0e406d130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1040c6b70 tx=0x7fe0f4007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:02.977 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:02.976+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0ec0541c0 con 0x7fe1040b1eb0 2023-06-09T04:38:03.181 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.180+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe104074080 con 0x7fe1040b1eb0 2023-06-09T04:38:03.181 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.181+0000 7fe100ff9700 1 -- 172.21.15.26:0/1613161846 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10988 (secure 0 0 0) 0x7fe0ec015070 con 0x7fe1040b1eb0 2023-06-09T04:38:03.182 INFO:teuthology.misc.health.smithi026.stdout: 2023-06-09T04:38:03.182 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":14,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:03.129172+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:03.184 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe0e406ac80 msgr2=0x7fe0e406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.184 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe0e406ac80 0x7fe0e406d130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1040c6b70 tx=0x7fe0f4007ca0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.184 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 msgr2=0x7fe104152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.184 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 0x7fe104152e70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00b4a0 tx=0x7fe0ec00b7b0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.184 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 shutdown_connections 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe104159200 0x7fe1041e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe0e406ac80 0x7fe0e406d130 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1040b1eb0 0x7fe104152e70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 --2- 172.21.15.26:0/1613161846 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe1040cfec0 0x7fe1041e3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 >> 172.21.15.26:0/1613161846 conn(0x7fe10406fc00 msgr2=0x7fe104156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 shutdown_connections 2023-06-09T04:38:03.185 INFO:teuthology.misc.health.smithi026.stderr:2023-06-09T04:38:03.183+0000 7fe10a7d1700 1 -- 172.21.15.26:0/1613161846 wait complete. 2023-06-09T04:38:03.195 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-09T04:38:03.195 INFO:tasks.ceph:Creating RBD pool 2023-06-09T04:38:03.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-09T04:38:03.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.319+0000 7f321c75e700 1 Processor -- start 2023-06-09T04:38:03.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.319+0000 7f321c75e700 1 -- start start 2023-06-09T04:38:03.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.319+0000 7f321c75e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32140ca540 0x7f32140ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.319+0000 7f321c75e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3214159880 con 0x7f32140aed90 2023-06-09T04:38:03.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.319+0000 7f321c75e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321406cff0 con 0x7f32140ceae0 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.319+0000 7f321c75e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140cda30 con 0x7f32140ca540 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f3219cf9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32140ca540 0x7f32140ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f321a4fa700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f32140aed90 0x7f32140c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46200/0 (socket says 172.21.15.26:46200) 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f3219cf9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32140ca540 0x7f32140ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37344/0 (socket says 172.21.15.26:37344) 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f321a4fa700 1 -- 172.21.15.26:0/1006424094 learned_addr learned my addr 172.21.15.26:0/1006424094 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f3219cf9700 1 -- 172.21.15.26:0/1006424094 >> v1:172.21.15.104:6789/0 conn(0x7f32140ceae0 legacy=0x7f321406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:03.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f3219cf9700 1 -- 172.21.15.26:0/1006424094 >> v1:172.21.15.26:6789/0 conn(0x7f32140aed90 legacy=0x7f32140c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f32194f8700 1 -- 172.21.15.26:0/1006424094 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423847263 0 0) 0x7f3214159880 con 0x7f32140aed90 2023-06-09T04:38:03.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f3219cf9700 1 -- 172.21.15.26:0/1006424094 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140cf250 con 0x7f32140ca540 2023-06-09T04:38:03.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f3219cf9700 1 --2- 172.21.15.26:0/1006424094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140ca540 0x7f32140ce5a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3204009840 tx=0x7f3204009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7614a4d0b3bcc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:03.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f32194f8700 1 -- 172.21.15.26:0/1006424094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204011830 con 0x7f32140ca540 2023-06-09T04:38:03.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f32194f8700 1 -- 172.21.15.26:0/1006424094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204011990 con 0x7f32140ca540 2023-06-09T04:38:03.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.320+0000 7f32194f8700 1 -- 172.21.15.26:0/1006424094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204011d20 con 0x7f32140ca540 2023-06-09T04:38:03.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 -- 172.21.15.26:0/1006424094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140ca540 msgr2=0x7f32140ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 --2- 172.21.15.26:0/1006424094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140ca540 0x7f32140ce5a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3204009840 tx=0x7f3204009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 -- 172.21.15.26:0/1006424094 shutdown_connections 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 --2- 172.21.15.26:0/1006424094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140ca540 0x7f32140ce5a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 -- 172.21.15.26:0/1006424094 >> 172.21.15.26:0/1006424094 conn(0x7f3214098a30 msgr2=0x7f32140cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 -- 172.21.15.26:0/1006424094 shutdown_connections 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.321+0000 7f321c75e700 1 -- 172.21.15.26:0/1006424094 wait complete. 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.322+0000 7f321c75e700 1 Processor -- start 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.322+0000 7f321c75e700 1 -- start start 2023-06-09T04:38:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321c75e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 0x7f32140c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321c75e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32140ca540 0x7f3214142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321c75e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32140ceae0 0x7f32140c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321c75e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140c7020 con 0x7f32140aed90 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321c75e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140c6df0 con 0x7f32140ceae0 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321c75e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3214143030 con 0x7f32140ca540 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 0x7f32140c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 0x7f32140c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37348/0 (socket says 172.21.15.26:37348) 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 -- 172.21.15.26:0/1025712439 learned_addr learned my addr 172.21.15.26:0/1025712439 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f3219cf9700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32140ca540 0x7f3214142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321acfb700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32140ceae0 0x7f32140c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 -- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32140ca540 msgr2=0x7f3214142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32140ca540 0x7f3214142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 -- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32140ceae0 msgr2=0x7f32140c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32140ceae0 0x7f32140c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 -- 172.21.15.26:0/1025712439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040094a0 con 0x7f32140aed90 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.323+0000 7f321a4fa700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 0x7f32140c68b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f321000c420 tx=0x7f321000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.324+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100074e0 con 0x7f32140aed90 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.324+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3210007660 con 0x7f32140aed90 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.324+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3214149f70 con 0x7f32140aed90 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.324+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210005a70 con 0x7f32140aed90 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.324+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32140c9510 con 0x7f32140aed90 2023-06-09T04:38:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.324+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3214067180 con 0x7f32140aed90 2023-06-09T04:38:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.325+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f3210005bd0 con 0x7f32140aed90 2023-06-09T04:38:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.325+0000 7f320affd700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f31f806ac50 0x7f31f806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.325+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f3210088150 con 0x7f32140aed90 2023-06-09T04:38:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.326+0000 7f3219cf9700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f31f806ac50 0x7f31f806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.326+0000 7f3219cf9700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f31f806ac50 0x7f31f806d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3204009840 tx=0x7f3204008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.330+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3210053870 con 0x7f32140aed90 2023-06-09T04:38:03.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:03.528+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f32140b5640 con 0x7f32140aed90 2023-06-09T04:38:04.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.384+0000 7f320affd700 1 -- 172.21.15.26:0/1025712439 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3210056e90 con 0x7f32140aed90 2023-06-09T04:38:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.387+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f31f806ac50 msgr2=0x7f31f806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.387+0000 7f321c75e700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f31f806ac50 0x7f31f806d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3204009840 tx=0x7f3204008030 comp rx=0 tx=0).stop 2023-06-09T04:38:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 msgr2=0x7f32140c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 0x7f32140c68b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f321000c420 tx=0x7f321000c730 comp rx=0 tx=0).stop 2023-06-09T04:38:04.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 shutdown_connections 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32140ceae0 0x7f32140c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f31f806ac50 0x7f31f806d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32140aed90 0x7f32140c68b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 --2- 172.21.15.26:0/1025712439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32140ca540 0x7f3214142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 >> 172.21.15.26:0/1025712439 conn(0x7f3214098a30 msgr2=0x7f321406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 shutdown_connections 2023-06-09T04:38:04.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.388+0000 7f321c75e700 1 -- 172.21.15.26:0/1025712439 wait complete. 2023-06-09T04:38:04.391 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'rbd' created 2023-06-09T04:38:04.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-09T04:38:04.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.535+0000 7f2d4f677700 1 Processor -- start 2023-06-09T04:38:04.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.536+0000 7f2d4f677700 1 -- start start 2023-06-09T04:38:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.536+0000 7f2d4f677700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 0x7f2d480cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.536+0000 7f2d4f677700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d4806a4c0 0x7f2d480cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.536+0000 7f2d4f677700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4806ab10 con 0x7f2d4815fdb0 2023-06-09T04:38:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.536+0000 7f2d4f677700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480cb680 con 0x7f2d4806a4c0 2023-06-09T04:38:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.536+0000 7f2d4f677700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480cb960 con 0x7f2d48160ae0 2023-06-09T04:38:04.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4cc12700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d4815fdb0 0x7f2d48069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46288/0 (socket says 172.21.15.26:46288) 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4cc12700 1 -- 172.21.15.26:0/2529929188 learned_addr learned my addr 172.21.15.26:0/2529929188 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4d413700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 0x7f2d480cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4dc14700 1 --2- 172.21.15.26:0/2529929188 >> v2:172.21.15.104:3300/0 conn(0x7f2d4806a4c0 0x7f2d480cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959360041 0 0) 0x7f2d4806ab10 con 0x7f2d4815fdb0 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d340035b0 con 0x7f2d4815fdb0 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786373001 0 0) 0x7f2d340035b0 con 0x7f2d4815fdb0 2023-06-09T04:38:04.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 msgr2=0x7f2d480cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 0x7f2d480cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 >> v2:172.21.15.104:3300/0 conn(0x7f2d4806a4c0 msgr2=0x7f2d480cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 --2- 172.21.15.26:0/2529929188 >> v2:172.21.15.104:3300/0 conn(0x7f2d4806a4c0 0x7f2d480cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480cbc40 con 0x7f2d4815fdb0 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f2d44001670 con 0x7f2d4815fdb0 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 >> v1:172.21.15.26:6789/0 conn(0x7f2d4815fdb0 legacy=0x7f2d48069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d34003a70 0x7f2d34003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 0x7f2d34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34004d90 0x7f2d34005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480cb680 con 0x7f2d34003a70 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480cb960 con 0x7f2d34004d90 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3400ba10 con 0x7f2d48160ae0 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4dc14700 1 --2- 172.21.15.26:0/2529929188 >> v2:172.21.15.104:3300/0 conn(0x7f2d4806a4c0 0x7f2d480cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4d413700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d34003a70 0x7f2d34003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4cc12700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 0x7f2d34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.537+0000 7f2d4dc14700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34004d90 0x7f2d34005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4d413700 1 -- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 msgr2=0x7f2d34004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4d413700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d48160ae0 0x7f2d34004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4d413700 1 -- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34004d90 msgr2=0x7f2d34005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4d413700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34004d90 0x7f2d34005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4d413700 1 -- 172.21.15.26:0/2529929188 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340035b0 con 0x7f2d34003a70 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4dc14700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34004d90 0x7f2d34005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:04.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4d413700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d34003a70 0x7f2d34003e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009b70 tx=0x7f2d34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331b875edc3b762f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38005a20 con 0x7f2d34003a70 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38005b80 con 0x7f2d34003a70 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d3ffff700 1 -- 172.21.15.26:0/2529929188 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3800e660 con 0x7f2d34003a70 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4f677700 1 -- 172.21.15.26:0/2529929188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d34003a70 msgr2=0x7f2d34003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4f677700 1 --2- 172.21.15.26:0/2529929188 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d34003a70 0x7f2d34003e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009b70 tx=0x7f2d34005880 comp rx=0 tx=0).stop 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4dc14700 1 -- 172.21.15.26:0/2529929188 reap_dead start 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4f677700 1 -- 172.21.15.26:0/2529929188 shutdown_connections 2023-06-09T04:38:04.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.538+0000 7f2d4f677700 1 -- 172.21.15.26:0/2529929188 >> 172.21.15.26:0/2529929188 conn(0x7f2d4806b7e0 msgr2=0x7f2d480cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:04.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.539+0000 7f2d4f677700 1 -- 172.21.15.26:0/2529929188 shutdown_connections 2023-06-09T04:38:04.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.539+0000 7f2d4f677700 1 -- 172.21.15.26:0/2529929188 wait complete. 2023-06-09T04:38:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.540+0000 7f2d4f677700 1 Processor -- start 2023-06-09T04:38:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.540+0000 7f2d4f677700 1 -- start start 2023-06-09T04:38:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34003a70 0x7f2d480c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 0x7f2d4814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d480c81d0 0x7f2d480c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d481e8590 con 0x7f2d48150740 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d481e8870 con 0x7f2d34003a70 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d481e7120 con 0x7f2d480c81d0 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 0x7f2d4814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 0x7f2d4814fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37442/0 (socket says 172.21.15.26:37442) 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 -- 172.21.15.26:0/1397763349 learned_addr learned my addr 172.21.15.26:0/1397763349 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 -- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d480c81d0 msgr2=0x7f2d480c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d480c81d0 0x7f2d480c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4d413700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34003a70 0x7f2d480c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 -- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34003a70 msgr2=0x7f2d480c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34003a70 0x7f2d480c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 -- 172.21.15.26:0/1397763349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d481e7400 con 0x7f2d48150740 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4cc12700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 0x7f2d4814fe60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d44007290 tx=0x7f2d44007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400f6c0 con 0x7f2d48150740 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400f840 con 0x7f2d48150740 2023-06-09T04:38:04.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d480c8b90 con 0x7f2d48150740 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.541+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400fbf0 con 0x7f2d48150740 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.542+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d481503a0 con 0x7f2d48150740 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.543+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d48067180 con 0x7f2d48150740 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.543+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f2d4400fd50 con 0x7f2d48150740 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.543+0000 7f2d3dffb700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2d2c06ac50 0x7f2d2c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.544+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f2d44088fb0 con 0x7f2d48150740 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.544+0000 7f2d4d413700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2d2c06ac50 0x7f2d2c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.544+0000 7f2d4d413700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2d2c06ac50 0x7f2d2c06d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009b10 tx=0x7f2d38008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.548+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d440bb310 con 0x7f2d48150740 2023-06-09T04:38:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:04.747+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d480c2f60 con 0x7f2d48150740 2023-06-09T04:38:05.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.389+0000 7f2d3dffb700 1 -- 172.21.15.26:0/1397763349 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2d440544a0 con 0x7f2d48150740 2023-06-09T04:38:05.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2d2c06ac50 msgr2=0x7f2d2c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2d2c06ac50 0x7f2d2c06d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009b10 tx=0x7f2d38008030 comp rx=0 tx=0).stop 2023-06-09T04:38:05.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 msgr2=0x7f2d4814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 0x7f2d4814fe60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d44007290 tx=0x7f2d44007650 comp rx=0 tx=0).stop 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 shutdown_connections 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d480c81d0 0x7f2d480c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d34003a70 0x7f2d480c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2d2c06ac50 0x7f2d2c06d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 --2- 172.21.15.26:0/1397763349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d48150740 0x7f2d4814fe60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 >> 172.21.15.26:0/1397763349 conn(0x7f2d4806b7e0 msgr2=0x7f2d4806e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 shutdown_connections 2023-06-09T04:38:05.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.392+0000 7f2d4f677700 1 -- 172.21.15.26:0/1397763349 wait complete. 2023-06-09T04:38:05.395 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-09T04:38:05.409 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-09T04:38:05.410 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:38:05.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:38:05.412 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:38:05.412 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:38:05.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:38:05.414 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:38:05.415 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:38:05.415 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:38:05.417 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:38:05.417 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:38:05.417 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:38:05.419 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:38:05.420 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-09T04:38:05.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:05.508 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-06-09T04:38:05.509 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-06-09T04:38:05.513 INFO:tasks.ceph.mds.b.smithi104.stdout:starting mds.b at 2023-06-09T04:38:05.515 INFO:tasks.ceph.mds.d.smithi104.stdout:starting mds.d at 2023-06-09T04:38:05.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.566+0000 7fed7482b700 1 Processor -- start 2023-06-09T04:38:05.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.566+0000 7fed7482b700 1 -- start start 2023-06-09T04:38:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed7482b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fed7015a310 0x7fed700cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed7482b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed70069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed7482b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed700cd880 con 0x7fed7015a6e0 2023-06-09T04:38:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed7482b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed700ce280 con 0x7fed7015a310 2023-06-09T04:38:05.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed7482b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed700acb20 con 0x7fed70098ea0 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed6dd9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fed7015a6e0 0x7fed700ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46340/0 (socket says 172.21.15.26:46340) 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.567+0000 7fed6dd9b700 1 -- 172.21.15.26:0/4178131994 learned_addr learned my addr 172.21.15.26:0/4178131994 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6e59c700 1 --2- 172.21.15.26:0/4178131994 >> v2:172.21.15.104:3300/0 conn(0x7fed7015a310 0x7fed700cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6ed9d700 1 --2- 172.21.15.26:0/4178131994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed70069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6d59a700 1 -- 172.21.15.26:0/4178131994 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101645693 0 0) 0x7fed700cd880 con 0x7fed7015a6e0 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6d59a700 1 -- 172.21.15.26:0/4178131994 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed580035b0 con 0x7fed7015a6e0 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6ed9d700 1 -- 172.21.15.26:0/4178131994 >> v2:172.21.15.104:3300/0 conn(0x7fed7015a310 msgr2=0x7fed700cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:05.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6ed9d700 1 --2- 172.21.15.26:0/4178131994 >> v2:172.21.15.104:3300/0 conn(0x7fed7015a310 0x7fed700cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6ed9d700 1 -- 172.21.15.26:0/4178131994 >> v1:172.21.15.26:6789/0 conn(0x7fed7015a6e0 legacy=0x7fed700ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6ed9d700 1 -- 172.21.15.26:0/4178131994 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700cdb60 con 0x7fed70098ea0 2023-06-09T04:38:05.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6ed9d700 1 --2- 172.21.15.26:0/4178131994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed70069db0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed68009d90 tx=0x7fed6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=713658f9893f20fe server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6d59a700 1 -- 172.21.15.26:0/4178131994 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800e070 con 0x7fed70098ea0 2023-06-09T04:38:05.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6d59a700 1 -- 172.21.15.26:0/4178131994 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6800bb20 con 0x7fed70098ea0 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.568+0000 7fed6d59a700 1 -- 172.21.15.26:0/4178131994 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68012430 con 0x7fed70098ea0 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 -- 172.21.15.26:0/4178131994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 msgr2=0x7fed70069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 --2- 172.21.15.26:0/4178131994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed70069db0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed68009d90 tx=0x7fed6800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 -- 172.21.15.26:0/4178131994 shutdown_connections 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 --2- 172.21.15.26:0/4178131994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed70069db0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 --2- 172.21.15.26:0/4178131994 >> v2:172.21.15.104:3300/0 conn(0x7fed7015a310 0x7fed700cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 -- 172.21.15.26:0/4178131994 >> 172.21.15.26:0/4178131994 conn(0x7fed70098a30 msgr2=0x7fed700cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 -- 172.21.15.26:0/4178131994 shutdown_connections 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.569+0000 7fed7482b700 1 -- 172.21.15.26:0/4178131994 wait complete. 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.570+0000 7fed7482b700 1 Processor -- start 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.570+0000 7fed7482b700 1 -- start start 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed7482b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed700c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed7482b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7015a310 0x7fed700c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed7482b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 0x7fed700c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed7482b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70157820 con 0x7fed7015a6e0 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed7482b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70157ac0 con 0x7fed7015a310 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed7482b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed70157d80 con 0x7fed70098ea0 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 0x7fed700c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 0x7fed700c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37490/0 (socket says 172.21.15.26:37490) 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6ed9d700 1 -- 172.21.15.26:0/3172532025 learned_addr learned my addr 172.21.15.26:0/3172532025 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6dd9b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7015a310 0x7fed700c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6e59c700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed700c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6ed9d700 1 -- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 msgr2=0x7fed700c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6ed9d700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed700c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.571+0000 7fed6ed9d700 1 -- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7015a310 msgr2=0x7fed700c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed6ed9d700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7015a310 0x7fed700c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed6ed9d700 1 -- 172.21.15.26:0/3172532025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed68009a70 con 0x7fed7015a6e0 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed6dd9b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7015a310 0x7fed700c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed6ed9d700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 0x7fed700c5130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed68014040 tx=0x7fed68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed680129f0 con 0x7fed7015a6e0 2023-06-09T04:38:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed68020070 con 0x7fed7015a6e0 2023-06-09T04:38:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed70158060 con 0x7fed7015a6e0 2023-06-09T04:38:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68012db0 con 0x7fed7015a6e0 2023-06-09T04:38:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.572+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7015add0 con 0x7fed7015a6e0 2023-06-09T04:38:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.573+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed70067180 con 0x7fed7015a6e0 2023-06-09T04:38:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.573+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fed68004040 con 0x7fed7015a6e0 2023-06-09T04:38:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.574+0000 7fed5effd700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fed5006ac50 0x7fed5006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.574+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fed68022070 con 0x7fed7015a6e0 2023-06-09T04:38:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.574+0000 7fed6e59c700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fed5006ac50 0x7fed5006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.574+0000 7fed6e59c700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fed5006ac50 0x7fed5006d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ab0 tx=0x7fed60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.578+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed68056600 con 0x7fed7015a6e0 2023-06-09T04:38:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.782+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed7006e190 con 0x7fed7015a6e0 2023-06-09T04:38:05.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.783+0000 7fed5effd700 1 -- 172.21.15.26:0/3172532025 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14593 (secure 0 0 0) 0x7fed68059c20 con 0x7fed7015a6e0 2023-06-09T04:38:05.784 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:05.785 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:05.383890+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:05.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fed5006ac50 msgr2=0x7fed5006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fed5006ac50 0x7fed5006d100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ab0 tx=0x7fed60008040 comp rx=0 tx=0).stop 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 msgr2=0x7fed700c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 0x7fed700c5130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed68014040 tx=0x7fed68004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 shutdown_connections 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fed5006ac50 0x7fed5006d100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7015a6e0 0x7fed700c5130 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fed70098ea0 0x7fed700c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 --2- 172.21.15.26:0/3172532025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7015a310 0x7fed700c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 >> 172.21.15.26:0/3172532025 conn(0x7fed70098a30 msgr2=0x7fed700ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 shutdown_connections 2023-06-09T04:38:05.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.785+0000 7fed7482b700 1 -- 172.21.15.26:0/3172532025 wait complete. 2023-06-09T04:38:05.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:05.799 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:05.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.930+0000 7f3313bf8700 1 Processor -- start 2023-06-09T04:38:05.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.930+0000 7f3313bf8700 1 -- start start 2023-06-09T04:38:05.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3313bf8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f330c15c200 0x7f330c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3313bf8700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f330c0ce8d0 0x7f330c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3313bf8700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c071ad0 con 0x7f330c06b2b0 2023-06-09T04:38:05.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3313bf8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0718c0 con 0x7f330c15c200 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3313bf8700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c070b40 con 0x7f330c0ce8d0 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3311994700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f330c15c200 0x7f330c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3311994700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f330c15c200 0x7f330c0cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37494/0 (socket says 172.21.15.26:37494) 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.931+0000 7f3311994700 1 -- 172.21.15.26:0/2753575874 learned_addr learned my addr 172.21.15.26:0/2753575874 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3312195700 1 --2- 172.21.15.26:0/2753575874 >> v2:172.21.15.104:3300/0 conn(0x7f330c0ce8d0 0x7f330c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3311994700 1 -- 172.21.15.26:0/2753575874 >> v2:172.21.15.104:3300/0 conn(0x7f330c0ce8d0 msgr2=0x7f330c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:05.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3311994700 1 --2- 172.21.15.26:0/2753575874 >> v2:172.21.15.104:3300/0 conn(0x7f330c0ce8d0 0x7f330c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3311994700 1 -- 172.21.15.26:0/2753575874 >> v1:172.21.15.104:6789/0 conn(0x7f330c06b2b0 legacy=0x7f330c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3310992700 1 -- 172.21.15.26:0/2753575874 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967064830 0 0) 0x7f330c071ad0 con 0x7f330c06b2b0 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3311994700 1 -- 172.21.15.26:0/2753575874 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c070e20 con 0x7f330c15c200 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3311994700 1 --2- 172.21.15.26:0/2753575874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c15c200 0x7f330c0cb470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f330c09d050 tx=0x7f3308009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea447d90c410ffb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3310992700 1 -- 172.21.15.26:0/2753575874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308011830 con 0x7f330c15c200 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3310992700 1 -- 172.21.15.26:0/2753575874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308011990 con 0x7f330c15c200 2023-06-09T04:38:05.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.932+0000 7f3310992700 1 -- 172.21.15.26:0/2753575874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308011d20 con 0x7f330c15c200 2023-06-09T04:38:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 -- 172.21.15.26:0/2753575874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c15c200 msgr2=0x7f330c0cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2753575874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c15c200 0x7f330c0cb470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f330c09d050 tx=0x7f3308009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 -- 172.21.15.26:0/2753575874 shutdown_connections 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2753575874 >> v2:172.21.15.104:3300/0 conn(0x7f330c0ce8d0 0x7f330c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2753575874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c15c200 0x7f330c0cb470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 -- 172.21.15.26:0/2753575874 >> 172.21.15.26:0/2753575874 conn(0x7f330c0cb9d0 msgr2=0x7f330c0cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 -- 172.21.15.26:0/2753575874 shutdown_connections 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.933+0000 7f3313bf8700 1 -- 172.21.15.26:0/2753575874 wait complete. 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.934+0000 7f3313bf8700 1 Processor -- start 2023-06-09T04:38:05.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.934+0000 7f3313bf8700 1 -- start start 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f330c06b2b0 0x7f330c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 0x7f330c1f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f330c15c200 0x7f330c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0b1d80 con 0x7f330c0ce8d0 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0b1f90 con 0x7f330c15c200 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0b2270 con 0x7f330c06b2b0 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 0x7f330c1f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 0x7f330c1f1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37500/0 (socket says 172.21.15.26:37500) 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 -- 172.21.15.26:0/2567154040 learned_addr learned my addr 172.21.15.26:0/2567154040 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3312195700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f330c15c200 0x7f330c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311994700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f330c06b2b0 0x7f330c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 -- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f330c06b2b0 msgr2=0x7f330c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f330c06b2b0 0x7f330c0b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 -- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f330c15c200 msgr2=0x7f330c0b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f330c15c200 0x7f330c0b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 -- 172.21.15.26:0/2567154040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308009550 con 0x7f330c0ce8d0 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3311193700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 0x7f330c1f1230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c550 tx=0x7f32fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0054e0 con 0x7f330c0ce8d0 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc003680 con 0x7f330c0ce8d0 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.935+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c0b2550 con 0x7f330c0ce8d0 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.936+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc003a30 con 0x7f330c0ce8d0 2023-06-09T04:38:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.936+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c0b2b10 con 0x7f330c0ce8d0 2023-06-09T04:38:05.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.937+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f32fc003b90 con 0x7f330c0ce8d0 2023-06-09T04:38:05.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.937+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c0b2d30 con 0x7f330c0ce8d0 2023-06-09T04:38:05.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.937+0000 7f33027fc700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f32f006ac50 0x7f32f006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.938+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f32fc088460 con 0x7f330c0ce8d0 2023-06-09T04:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.938+0000 7f3311994700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f32f006ac50 0x7f32f006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.938+0000 7f3311994700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f32f006ac50 0x7f32f006d100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3308009c10 tx=0x7f3308008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:05.942+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32fc0539d0 con 0x7f330c0ce8d0 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.146+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f330c067180 con 0x7f330c0ce8d0 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.146+0000 7f33027fc700 1 -- 172.21.15.26:0/2567154040 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32fc017020 con 0x7f330c0ce8d0 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f32f006ac50 msgr2=0x7f32f006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f32f006ac50 0x7f32f006d100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3308009c10 tx=0x7f3308008030 comp rx=0 tx=0).stop 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 msgr2=0x7f330c1f1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 0x7f330c1f1230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c550 tx=0x7f32fc00c910 comp rx=0 tx=0).stop 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 shutdown_connections 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f330c15c200 0x7f330c0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f330c06b2b0 0x7f330c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f32f006ac50 0x7f32f006d100 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 --2- 172.21.15.26:0/2567154040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f330c0ce8d0 0x7f330c1f1230 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 >> 172.21.15.26:0/2567154040 conn(0x7f330c0cb9d0 msgr2=0x7f330c0ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 shutdown_connections 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.148+0000 7f3313bf8700 1 -- 172.21.15.26:0/2567154040 wait complete. 2023-06-09T04:38:06.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:06.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.287+0000 7f9323b13700 1 Processor -- start 2023-06-09T04:38:06.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.287+0000 7f9323b13700 1 -- start start 2023-06-09T04:38:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f9323b13700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f931c15a310 0x7f931c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f9323b13700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c15a6e0 0x7f931c0ac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f9323b13700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f931c098ea0 0x7f931c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f9323b13700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c0ce280 con 0x7f931c15a310 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f9323b13700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c0cd880 con 0x7f931c098ea0 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f9323b13700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0cdb60 con 0x7f931c15a6e0 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f93218af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f931c15a310 0x7f931c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f93218af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f931c15a310 0x7f931c0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37506/0 (socket says 172.21.15.26:37506) 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f93218af700 1 -- 172.21.15.26:0/3444923995 learned_addr learned my addr 172.21.15.26:0/3444923995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f93220b0700 1 --2- 172.21.15.26:0/3444923995 >> v2:172.21.15.104:3300/0 conn(0x7f931c098ea0 0x7f931c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.288+0000 7f93210ae700 1 --2- 172.21.15.26:0/3444923995 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c15a6e0 0x7f931c0ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93218af700 1 -- 172.21.15.26:0/3444923995 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c15a6e0 msgr2=0x7f931c0ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93218af700 1 --2- 172.21.15.26:0/3444923995 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c15a6e0 0x7f931c0ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93218af700 1 -- 172.21.15.26:0/3444923995 >> v2:172.21.15.104:3300/0 conn(0x7f931c098ea0 msgr2=0x7f931c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93218af700 1 --2- 172.21.15.26:0/3444923995 >> v2:172.21.15.104:3300/0 conn(0x7f931c098ea0 0x7f931c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93218af700 1 -- 172.21.15.26:0/3444923995 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c06e190 con 0x7f931c15a310 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93218af700 1 --2- 172.21.15.26:0/3444923995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0cede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f931c066960 tx=0x7f930c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8efad097b14690 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93208ad700 1 -- 172.21.15.26:0/3444923995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00e070 con 0x7f931c15a310 2023-06-09T04:38:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93208ad700 1 -- 172.21.15.26:0/3444923995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00b910 con 0x7f931c15a310 2023-06-09T04:38:06.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.289+0000 7f93208ad700 1 -- 172.21.15.26:0/3444923995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00bcc0 con 0x7f931c15a310 2023-06-09T04:38:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 -- 172.21.15.26:0/3444923995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 msgr2=0x7f931c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 --2- 172.21.15.26:0/3444923995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0cede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f931c066960 tx=0x7f930c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 -- 172.21.15.26:0/3444923995 shutdown_connections 2023-06-09T04:38:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 --2- 172.21.15.26:0/3444923995 >> v2:172.21.15.104:3300/0 conn(0x7f931c098ea0 0x7f931c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 --2- 172.21.15.26:0/3444923995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0cede0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 --2- 172.21.15.26:0/3444923995 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c15a6e0 0x7f931c0ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 -- 172.21.15.26:0/3444923995 >> 172.21.15.26:0/3444923995 conn(0x7f931c098a30 msgr2=0x7f931c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 -- 172.21.15.26:0/3444923995 shutdown_connections 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.290+0000 7f9323b13700 1 -- 172.21.15.26:0/3444923995 wait complete. 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.291+0000 7f9323b13700 1 Processor -- start 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.291+0000 7f9323b13700 1 -- start start 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c098ea0 0x7f931c1f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f931c15a6e0 0x7f931c09b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0c32f0 con 0x7f931c15a310 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0c4150 con 0x7f931c15a6e0 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1f0e80 con 0x7f931c098ea0 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37514/0 (socket says 172.21.15.26:37514) 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 -- 172.21.15.26:0/3962743420 learned_addr learned my addr 172.21.15.26:0/3962743420 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:06.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93218af700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c098ea0 0x7f931c1f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93220b0700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f931c15a6e0 0x7f931c09b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 -- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c098ea0 msgr2=0x7f931c1f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c098ea0 0x7f931c1f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 -- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f931c15a6e0 msgr2=0x7f931c09b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f931c15a6e0 0x7f931c09b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 -- 172.21.15.26:0/3962743420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c009b30 con 0x7f931c15a310 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f93210ae700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0c45e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f931000e9e0 tx=0x7f931000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310009710 con 0x7f931c15a310 2023-06-09T04:38:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931000ee80 con 0x7f931c15a310 2023-06-09T04:38:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c0c3540 con 0x7f931c15a310 2023-06-09T04:38:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000ca50 con 0x7f931c15a310 2023-06-09T04:38:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.292+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c0c3b00 con 0x7f931c15a310 2023-06-09T04:38:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.293+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c0c42e0 con 0x7f931c15a310 2023-06-09T04:38:06.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.294+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f931000cbb0 con 0x7f931c15a310 2023-06-09T04:38:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.294+0000 7f931a7fc700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f930806ac50 0x7f930806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.294+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9310089010 con 0x7f931c15a310 2023-06-09T04:38:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.294+0000 7f93218af700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f930806ac50 0x7f930806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.295+0000 7f93218af700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f930806ac50 0x7f930806d100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f930c000f80 tx=0x7f930c009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.393+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f93100544f0 con 0x7f931c15a310 2023-06-09T04:38:06.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.593+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f931c067180 con 0x7f931c15a310 2023-06-09T04:38:06.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.593+0000 7f931a7fc700 1 -- 172.21.15.26:0/3962743420 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9310057b10 con 0x7f931c15a310 2023-06-09T04:38:06.595 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f930806ac50 msgr2=0x7f930806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f930806ac50 0x7f930806d100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f930c000f80 tx=0x7f930c009000 comp rx=0 tx=0).stop 2023-06-09T04:38:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 msgr2=0x7f931c0c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0c45e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f931000e9e0 tx=0x7f931000ecf0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 shutdown_connections 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f931c15a6e0 0x7f931c09b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f931c098ea0 0x7f931c1f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f930806ac50 0x7f930806d100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 --2- 172.21.15.26:0/3962743420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f931c15a310 0x7f931c0c45e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 >> 172.21.15.26:0/3962743420 conn(0x7f931c098a30 msgr2=0x7f931c0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 shutdown_connections 2023-06-09T04:38:06.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.596+0000 7f9323b13700 1 -- 172.21.15.26:0/3962743420 wait complete. 2023-06-09T04:38:06.609 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.734+0000 7f844d0ed700 1 Processor -- start 2023-06-09T04:38:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.734+0000 7f844d0ed700 1 -- start start 2023-06-09T04:38:06.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844d0ed700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f844815a340 0x7f84480b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844d0ed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84480ce4b0 0x7f84480ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844d0ed700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84480cee40 con 0x7f84480b0140 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844d0ed700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844815a710 con 0x7f84480ce4b0 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844d0ed700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84480d08b0 con 0x7f844815a340 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84480ce4b0 0x7f84480ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844759e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f84480b0140 0x7f84480ad470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46384/0 (socket says 172.21.15.26:46384) 2023-06-09T04:38:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844759e700 1 -- 172.21.15.26:0/3864730190 learned_addr learned my addr 172.21.15.26:0/3864730190 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f8446d9d700 1 --2- 172.21.15.26:0/3864730190 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f844815a340 0x7f84480b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844659c700 1 -- 172.21.15.26:0/3864730190 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f844815a340 msgr2=0x7f84480b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844659c700 1 --2- 172.21.15.26:0/3864730190 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f844815a340 0x7f84480b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844659c700 1 -- 172.21.15.26:0/3864730190 >> v1:172.21.15.26:6789/0 conn(0x7f84480b0140 legacy=0x7f84480ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f8445d9b700 1 -- 172.21.15.26:0/3864730190 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46349614 0 0) 0x7f8440001490 con 0x7f84480b0140 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844659c700 1 -- 172.21.15.26:0/3864730190 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480b0d20 con 0x7f84480ce4b0 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f844659c700 1 --2- 172.21.15.26:0/3864730190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480ce4b0 0x7f84480ce900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f843c009840 tx=0x7f843c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e85f63ea1f57b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f8445d9b700 1 -- 172.21.15.26:0/3864730190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c011830 con 0x7f84480ce4b0 2023-06-09T04:38:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f8445d9b700 1 -- 172.21.15.26:0/3864730190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c011990 con 0x7f84480ce4b0 2023-06-09T04:38:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.735+0000 7f8445d9b700 1 -- 172.21.15.26:0/3864730190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c011d20 con 0x7f84480ce4b0 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 -- 172.21.15.26:0/3864730190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480ce4b0 msgr2=0x7f84480ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 --2- 172.21.15.26:0/3864730190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480ce4b0 0x7f84480ce900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f843c009840 tx=0x7f843c009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 -- 172.21.15.26:0/3864730190 shutdown_connections 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 --2- 172.21.15.26:0/3864730190 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f844815a340 0x7f84480b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 --2- 172.21.15.26:0/3864730190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480ce4b0 0x7f84480ce900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 -- 172.21.15.26:0/3864730190 >> 172.21.15.26:0/3864730190 conn(0x7f8448089fc0 msgr2=0x7f844808a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 -- 172.21.15.26:0/3864730190 shutdown_connections 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.736+0000 7f844d0ed700 1 -- 172.21.15.26:0/3864730190 wait complete. 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.738+0000 7f844d0ed700 1 Processor -- start 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.738+0000 7f844d0ed700 1 -- start start 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844d0ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 0x7f84481ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844d0ed700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f84480ce4b0 0x7f84480ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844d0ed700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f844815a340 0x7f84481f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844d0ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84480b4e80 con 0x7f84480b0140 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844d0ed700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84481efed0 con 0x7f844815a340 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844d0ed700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84481f01b0 con 0x7f84480ce4b0 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 0x7f84481ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 0x7f84481ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37528/0 (socket says 172.21.15.26:37528) 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 -- 172.21.15.26:0/2839267220 learned_addr learned my addr 172.21.15.26:0/2839267220 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844659c700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f84480ce4b0 0x7f84480ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844759e700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f844815a340 0x7f84481f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 -- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f84480ce4b0 msgr2=0x7f84480ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f84480ce4b0 0x7f84480ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 -- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f844815a340 msgr2=0x7f84481f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f844815a340 0x7f84481f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 -- 172.21.15.26:0/2839267220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0094a0 con 0x7f84480b0140 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f844759e700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f844815a340 0x7f84481f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.739+0000 7f8446d9d700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 0x7f84481ef8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f843800d7d0 tx=0x7f843800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.740+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380125f0 con 0x7f84480b0140 2023-06-09T04:38:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.740+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438012750 con 0x7f84480b0140 2023-06-09T04:38:06.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.740+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438012b00 con 0x7f84480b0140 2023-06-09T04:38:06.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.740+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84481f0490 con 0x7f84480b0140 2023-06-09T04:38:06.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.740+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84480af020 con 0x7f84480b0140 2023-06-09T04:38:06.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.740+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84480b4fc0 con 0x7f84480b0140 2023-06-09T04:38:06.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.741+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8438012c60 con 0x7f84480b0140 2023-06-09T04:38:06.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.741+0000 7f842f7fe700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f843406ace0 0x7f843406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.741+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8438089180 con 0x7f84480b0140 2023-06-09T04:38:06.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.742+0000 7f844659c700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f843406ace0 0x7f843406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.742+0000 7f844659c700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f843406ace0 0x7f843406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f843c000c00 tx=0x7f843c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.747+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8438054500 con 0x7f84480b0140 2023-06-09T04:38:06.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.989+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8448066da0 con 0x7f84480b0140 2023-06-09T04:38:06.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.989+0000 7f842f7fe700 1 -- 172.21.15.26:0/2839267220 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f8438057b20 con 0x7f84480b0140 2023-06-09T04:38:06.991 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:06.991 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-09T04:38:06.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.991+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f843406ace0 msgr2=0x7f843406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.991+0000 7f844d0ed700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f843406ace0 0x7f843406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f843c000c00 tx=0x7f843c008030 comp rx=0 tx=0).stop 2023-06-09T04:38:06.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.991+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 msgr2=0x7f84481ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.991+0000 7f844d0ed700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 0x7f84481ef8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f843800d7d0 tx=0x7f843800dae0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 shutdown_connections 2023-06-09T04:38:06.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f844815a340 0x7f84481f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f843406ace0 0x7f843406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84480b0140 0x7f84481ef8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 --2- 172.21.15.26:0/2839267220 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f84480ce4b0 0x7f84480ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 >> 172.21.15.26:0/2839267220 conn(0x7f8448089fc0 msgr2=0x7f84481573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 shutdown_connections 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:06.992+0000 7f844d0ed700 1 -- 172.21.15.26:0/2839267220 wait complete. 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2023-06-09T04:38:07.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.128+0000 7fa3ed6fa700 1 Processor -- start 2023-06-09T04:38:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.128+0000 7fa3ed6fa700 1 -- start start 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3ed6fa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e80d1840 0x7fa3e815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3ed6fa700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa3e80d0c50 0x7fa3e80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3ed6fa700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e80cf400 con 0x7fa3e8159d00 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3ed6fa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80ceec0 con 0x7fa3e80d1840 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3ed6fa700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e815d830 con 0x7fa3e80d0c50 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e80d1840 0x7fa3e815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3e80d1840 0x7fa3e815d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37536/0 (socket says 172.21.15.26:37536) 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 -- 172.21.15.26:0/1985968166 learned_addr learned my addr 172.21.15.26:0/1985968166 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e77fe700 1 --2- 172.21.15.26:0/1985968166 >> v2:172.21.15.104:3300/0 conn(0x7fa3e80d0c50 0x7fa3e80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 -- 172.21.15.26:0/1985968166 >> v2:172.21.15.104:3300/0 conn(0x7fa3e80d0c50 msgr2=0x7fa3e80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 --2- 172.21.15.26:0/1985968166 >> v2:172.21.15.104:3300/0 conn(0x7fa3e80d0c50 0x7fa3e80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 -- 172.21.15.26:0/1985968166 >> v1:172.21.15.104:6789/0 conn(0x7fa3e8159d00 legacy=0x7fa3e80cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.129+0000 7fa3e67fc700 1 -- 172.21.15.26:0/1985968166 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e80cf0d0 con 0x7fa3e80d1840 2023-06-09T04:38:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3e67fc700 1 --2- 172.21.15.26:0/1985968166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e815d2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8072050 tx=0x7fa3d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5c56d2c720dbda server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3e5ffb700 1 -- 172.21.15.26:0/1985968166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8011830 con 0x7fa3e80d1840 2023-06-09T04:38:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3e5ffb700 1 -- 172.21.15.26:0/1985968166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8011990 con 0x7fa3e80d1840 2023-06-09T04:38:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3e5ffb700 1 -- 172.21.15.26:0/1985968166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8011d20 con 0x7fa3e80d1840 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/1985968166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 msgr2=0x7fa3e815d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/1985968166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e815d2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8072050 tx=0x7fa3d8009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/1985968166 shutdown_connections 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/1985968166 >> v2:172.21.15.104:3300/0 conn(0x7fa3e80d0c50 0x7fa3e80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/1985968166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e815d2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/1985968166 >> 172.21.15.26:0/1985968166 conn(0x7fa3e80714e0 msgr2=0x7fa3e80718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/1985968166 shutdown_connections 2023-06-09T04:38:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.130+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/1985968166 wait complete. 2023-06-09T04:38:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.132+0000 7fa3ed6fa700 1 Processor -- start 2023-06-09T04:38:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.132+0000 7fa3ed6fa700 1 -- start start 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3ed6fa700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3e80d0c50 0x7fa3e81f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3ed6fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e81f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3ed6fa700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3e8159d00 0x7fa3e80d2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3ed6fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81f2ea0 con 0x7fa3e80d1840 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3ed6fa700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80b5d80 con 0x7fa3e80d0c50 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3ed6fa700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80b6060 con 0x7fa3e8159d00 2023-06-09T04:38:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3e67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e81f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3e67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e81f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37544/0 (socket says 172.21.15.26:37544) 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3e67fc700 1 -- 172.21.15.26:0/2277749838 learned_addr learned my addr 172.21.15.26:0/2277749838 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3e6ffd700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3e80d0c50 0x7fa3e81f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.133+0000 7fa3e77fe700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3e8159d00 0x7fa3e80d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3e67fc700 1 -- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3e8159d00 msgr2=0x7fa3e80d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3e67fc700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3e8159d00 0x7fa3e80d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3e67fc700 1 -- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3e80d0c50 msgr2=0x7fa3e81f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3e67fc700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3e80d0c50 0x7fa3e81f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3e67fc700 1 -- 172.21.15.26:0/2277749838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009550 con 0x7fa3e80d1840 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3e67fc700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e81f2960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009c10 tx=0x7fa3d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8004510 con 0x7fa3e80d1840 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d801e070 con 0x7fa3e80d1840 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e80b6340 con 0x7fa3e80d1840 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80038e0 con 0x7fa3e80d1840 2023-06-09T04:38:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.134+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e80b6900 con 0x7fa3e80d1840 2023-06-09T04:38:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.135+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e8073be0 con 0x7fa3e80d1840 2023-06-09T04:38:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.135+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3d8003a40 con 0x7fa3e80d1840 2023-06-09T04:38:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.136+0000 7fa3cf7fe700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa3d406ace0 0x7fa3d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.136+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3d8089f70 con 0x7fa3e80d1840 2023-06-09T04:38:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.136+0000 7fa3e6ffd700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa3d406ace0 0x7fa3d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.136+0000 7fa3e6ffd700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa3d406ace0 0x7fa3d406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3e815eb90 tx=0x7fa3dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.140+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3d80bc310 con 0x7fa3e80d1840 2023-06-09T04:38:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.338+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3e8066580 con 0x7fa3e80d1840 2023-06-09T04:38:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.339+0000 7fa3cf7fe700 1 -- 172.21.15.26:0/2277749838 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14567 (secure 0 0 0) 0x7fa3d8015090 con 0x7fa3e80d1840 2023-06-09T04:38:07.340 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:07.340 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:06.388397+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa3d406ace0 msgr2=0x7fa3d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa3d406ace0 0x7fa3d406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3e815eb90 tx=0x7fa3dc009040 comp rx=0 tx=0).stop 2023-06-09T04:38:07.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 msgr2=0x7fa3e81f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e81f2960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009c10 tx=0x7fa3d8004750 comp rx=0 tx=0).stop 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 shutdown_connections 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3e8159d00 0x7fa3e80d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3e80d0c50 0x7fa3e81f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa3d406ace0 0x7fa3d406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 --2- 172.21.15.26:0/2277749838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3e80d1840 0x7fa3e81f2960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 >> 172.21.15.26:0/2277749838 conn(0x7fa3e80714e0 msgr2=0x7fa3e8158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 shutdown_connections 2023-06-09T04:38:07.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.341+0000 7fa3ed6fa700 1 -- 172.21.15.26:0/2277749838 wait complete. 2023-06-09T04:38:07.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:07.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.481+0000 7fa3bf122700 1 Processor -- start 2023-06-09T04:38:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.481+0000 7fa3bf122700 1 -- start start 2023-06-09T04:38:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bf122700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa3b80aed90 0x7fa3b80c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bf122700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80ca370 0x7fa3b80ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bf122700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3b80ceae0 0x7fa3b80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bf122700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80cda30 con 0x7fa3b80ceae0 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bf122700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80ca7e0 con 0x7fa3b80aed90 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bf122700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8159880 con 0x7fa3b80ca370 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3b80ceae0 0x7fa3b80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa3b80ceae0 0x7fa3b80cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37554/0 (socket says 172.21.15.26:37554) 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/932619813 learned_addr learned my addr 172.21.15.26:0/932619813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bcebe700 1 --2- 172.21.15.26:0/932619813 >> v2:172.21.15.104:3300/0 conn(0x7fa3b80aed90 0x7fa3b80c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3b7fff700 1 --2- 172.21.15.26:0/932619813 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80ca370 0x7fa3b80ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/932619813 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80ca370 msgr2=0x7fa3b80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 --2- 172.21.15.26:0/932619813 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80ca370 0x7fa3b80ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/932619813 >> v2:172.21.15.104:3300/0 conn(0x7fa3b80aed90 msgr2=0x7fa3b80c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 --2- 172.21.15.26:0/932619813 >> v2:172.21.15.104:3300/0 conn(0x7fa3b80aed90 0x7fa3b80c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/932619813 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b806cff0 con 0x7fa3b80ceae0 2023-06-09T04:38:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3bd6bf700 1 --2- 172.21.15.26:0/932619813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b80cbfb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8070e50 tx=0x7fa3b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f1d4e06fd8cba4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3b77fe700 1 -- 172.21.15.26:0/932619813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000e070 con 0x7fa3b80ceae0 2023-06-09T04:38:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3b77fe700 1 -- 172.21.15.26:0/932619813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b000b980 con 0x7fa3b80ceae0 2023-06-09T04:38:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.482+0000 7fa3b77fe700 1 -- 172.21.15.26:0/932619813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000bd30 con 0x7fa3b80ceae0 2023-06-09T04:38:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 -- 172.21.15.26:0/932619813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 msgr2=0x7fa3b80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 --2- 172.21.15.26:0/932619813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b80cbfb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8070e50 tx=0x7fa3b000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 -- 172.21.15.26:0/932619813 shutdown_connections 2023-06-09T04:38:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 --2- 172.21.15.26:0/932619813 >> v2:172.21.15.104:3300/0 conn(0x7fa3b80aed90 0x7fa3b80c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 --2- 172.21.15.26:0/932619813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b80cbfb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 --2- 172.21.15.26:0/932619813 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80ca370 0x7fa3b80ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 -- 172.21.15.26:0/932619813 >> 172.21.15.26:0/932619813 conn(0x7fa3b8098a30 msgr2=0x7fa3b80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 -- 172.21.15.26:0/932619813 shutdown_connections 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.483+0000 7fa3bf122700 1 -- 172.21.15.26:0/932619813 wait complete. 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.484+0000 7fa3bf122700 1 Processor -- start 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.484+0000 7fa3bf122700 1 -- start start 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bf122700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80aed90 0x7fa3b80c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bf122700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b80ca370 0x7fa3b80c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bf122700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b81ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bf122700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b81e1b20 con 0x7fa3b80ceae0 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bf122700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80c84c0 con 0x7fa3b80ca370 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bf122700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b27d0 con 0x7fa3b80aed90 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bd6bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b81ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bd6bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b81ef450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37560/0 (socket says 172.21.15.26:37560) 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/1666717881 learned_addr learned my addr 172.21.15.26:0/1666717881 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3bcebe700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80aed90 0x7fa3b80c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.485+0000 7fa3b7fff700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b80ca370 0x7fa3b80c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80aed90 msgr2=0x7fa3b80c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bd6bf700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80aed90 0x7fa3b80c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b80ca370 msgr2=0x7fa3b80c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bd6bf700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b80ca370 0x7fa3b80c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bd6bf700 1 -- 172.21.15.26:0/1666717881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009b30 con 0x7fa3b80ceae0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bd6bf700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b81ef450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000b730 tx=0x7fa3b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00048b0 con 0x7fa3b80ceae0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b00099b0 con 0x7fa3b80ceae0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b80c8cd0 con 0x7fa3b80ceae0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b001b670 con 0x7fa3b80ceae0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.486+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b80c8710 con 0x7fa3b80ceae0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.487+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b8067180 con 0x7fa3b80ceae0 2023-06-09T04:38:07.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.487+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3b001b7d0 con 0x7fa3b80ceae0 2023-06-09T04:38:07.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.488+0000 7fa3b57fa700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa39c06ace0 0x7fa39c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.488+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3b008a4e0 con 0x7fa3b80ceae0 2023-06-09T04:38:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.488+0000 7fa3bcebe700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa39c06ace0 0x7fa39c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.488+0000 7fa3bcebe700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa39c06ace0 0x7fa39c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac006fd0 tx=0x7fa3ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.492+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3b0055970 con 0x7fa3b80ceae0 2023-06-09T04:38:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.688+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3b80b2910 con 0x7fa3b80ceae0 2023-06-09T04:38:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.689+0000 7fa3b57fa700 1 -- 172.21.15.26:0/1666717881 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3b0058f90 con 0x7fa3b80ceae0 2023-06-09T04:38:07.690 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa39c06ace0 msgr2=0x7fa39c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa39c06ace0 0x7fa39c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac006fd0 tx=0x7fa3ac008040 comp rx=0 tx=0).stop 2023-06-09T04:38:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 msgr2=0x7fa3b81ef450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b81ef450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000b730 tx=0x7fa3b0004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 shutdown_connections 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa39c06ace0 0x7fa39c06d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3b80ceae0 0x7fa3b81ef450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3b80aed90 0x7fa3b80c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 --2- 172.21.15.26:0/1666717881 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b80ca370 0x7fa3b80c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 >> 172.21.15.26:0/1666717881 conn(0x7fa3b8098a30 msgr2=0x7fa3b80b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 shutdown_connections 2023-06-09T04:38:07.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.691+0000 7fa3bf122700 1 -- 172.21.15.26:0/1666717881 wait complete. 2023-06-09T04:38:07.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.829+0000 7fecd1b8e700 1 Processor -- start 2023-06-09T04:38:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.829+0000 7fecd1b8e700 1 -- start start 2023-06-09T04:38:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.830+0000 7fecd1b8e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feccc15a310 0x7feccc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.830+0000 7fecd1b8e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc0cd880 con 0x7feccc15a6e0 2023-06-09T04:38:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.830+0000 7fecd1b8e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc0cdb60 con 0x7feccc098ea0 2023-06-09T04:38:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.830+0000 7fecd1b8e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc0ce280 con 0x7feccc15a310 2023-06-09T04:38:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.830+0000 7feccaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feccc15a6e0 0x7feccc0ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46424/0 (socket says 172.21.15.26:46424) 2023-06-09T04:38:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.830+0000 7feccaffd700 1 -- 172.21.15.26:0/2210668661 learned_addr learned my addr 172.21.15.26:0/2210668661 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7feccb7fe700 1 --2- 172.21.15.26:0/2210668661 >> v2:172.21.15.104:3300/0 conn(0x7feccc15a310 0x7feccc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7fecca7fc700 1 -- 172.21.15.26:0/2210668661 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543703693 0 0) 0x7feccc0cd880 con 0x7feccc15a6e0 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7fecca7fc700 1 -- 172.21.15.26:0/2210668661 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb80035b0 con 0x7feccc15a6e0 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7feccb7fe700 1 -- 172.21.15.26:0/2210668661 >> v1:172.21.15.104:6789/0 conn(0x7feccc098ea0 legacy=0x7feccc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7feccb7fe700 1 -- 172.21.15.26:0/2210668661 >> v1:172.21.15.26:6789/0 conn(0x7feccc15a6e0 legacy=0x7feccc0ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7feccb7fe700 1 -- 172.21.15.26:0/2210668661 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc06e190 con 0x7feccc15a310 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7feccb7fe700 1 --2- 172.21.15.26:0/2210668661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc15a310 0x7feccc0cede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009820 tx=0x7fecbc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fea52d3a21ecfac server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7fecca7fc700 1 -- 172.21.15.26:0/2210668661 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc005e30 con 0x7feccc15a310 2023-06-09T04:38:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7fecca7fc700 1 -- 172.21.15.26:0/2210668661 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc006030 con 0x7feccc15a310 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.831+0000 7fecca7fc700 1 -- 172.21.15.26:0/2210668661 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0063a0 con 0x7feccc15a310 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 -- 172.21.15.26:0/2210668661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc15a310 msgr2=0x7feccc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/2210668661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc15a310 0x7feccc0cede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009820 tx=0x7fecbc009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 -- 172.21.15.26:0/2210668661 shutdown_connections 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/2210668661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc15a310 0x7feccc0cede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 -- 172.21.15.26:0/2210668661 >> 172.21.15.26:0/2210668661 conn(0x7feccc098a30 msgr2=0x7feccc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 -- 172.21.15.26:0/2210668661 shutdown_connections 2023-06-09T04:38:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.832+0000 7fecd1b8e700 1 -- 172.21.15.26:0/2210668661 wait complete. 2023-06-09T04:38:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.833+0000 7fecd1b8e700 1 Processor -- start 2023-06-09T04:38:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.833+0000 7fecd1b8e700 1 -- start start 2023-06-09T04:38:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7fecd1b8e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc098ea0 0x7feccc145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7fecd1b8e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 0x7feccc0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7fecd1b8e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feccc15a6e0 0x7feccc0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7fecd1b8e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c5680 con 0x7feccc15a310 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7fecd1b8e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc146220 con 0x7feccc098ea0 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7fecd1b8e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c47b0 con 0x7feccc15a6e0 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 0x7feccc0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 0x7feccc0c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37572/0 (socket says 172.21.15.26:37572) 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 -- 172.21.15.26:0/607508480 learned_addr learned my addr 172.21.15.26:0/607508480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccb7fe700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc098ea0 0x7feccc145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccbfff700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feccc15a6e0 0x7feccc0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 -- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feccc15a6e0 msgr2=0x7feccc0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feccc15a6e0 0x7feccc0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 -- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc098ea0 msgr2=0x7feccc145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc098ea0 0x7feccc145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.834+0000 7feccaffd700 1 -- 172.21.15.26:0/607508480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009430 con 0x7feccc15a310 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.835+0000 7feccaffd700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 0x7feccc0c5aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecb400c700 tx=0x7fecb400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.835+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4005d70 con 0x7feccc15a310 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.835+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb40070d0 con 0x7feccc15a310 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.835+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc0c4a00 con 0x7feccc15a310 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.835+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4007460 con 0x7feccc15a310 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.835+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc0c4fc0 con 0x7feccc15a310 2023-06-09T04:38:07.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.836+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0c57c0 con 0x7feccc15a310 2023-06-09T04:38:07.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.836+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecb40075c0 con 0x7feccc15a310 2023-06-09T04:38:07.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.837+0000 7fecc3fff700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fecac06ace0 0x7fecac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.837+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fecb40884e0 con 0x7feccc15a310 2023-06-09T04:38:07.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.837+0000 7feccb7fe700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fecac06ace0 0x7fecac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.837+0000 7feccb7fe700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fecac06ace0 0x7fecac06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009b70 tx=0x7fecbc008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:07.841+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feccc0c57c0 con 0x7feccc15a310 2023-06-09T04:38:08.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.037+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feccc0c57c0 con 0x7feccc15a310 2023-06-09T04:38:08.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.037+0000 7fecc3fff700 1 -- 172.21.15.26:0/607508480 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7feccc0c57c0 con 0x7feccc15a310 2023-06-09T04:38:08.039 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:08.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.039+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fecac06ace0 msgr2=0x7fecac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.039+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fecac06ace0 0x7fecac06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009b70 tx=0x7fecbc008070 comp rx=0 tx=0).stop 2023-06-09T04:38:08.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.039+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 msgr2=0x7feccc0c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.039+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 0x7feccc0c5aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecb400c700 tx=0x7fecb400ca10 comp rx=0 tx=0).stop 2023-06-09T04:38:08.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 shutdown_connections 2023-06-09T04:38:08.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feccc15a6e0 0x7feccc0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feccc098ea0 0x7feccc145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fecac06ace0 0x7fecac06d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 --2- 172.21.15.26:0/607508480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feccc15a310 0x7feccc0c5aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 >> 172.21.15.26:0/607508480 conn(0x7feccc098a30 msgr2=0x7feccc06e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 shutdown_connections 2023-06-09T04:38:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.040+0000 7fecd1b8e700 1 -- 172.21.15.26:0/607508480 wait complete. 2023-06-09T04:38:08.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:38:08.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.176+0000 7f9350df1700 1 Processor -- start 2023-06-09T04:38:08.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.176+0000 7f9350df1700 1 -- start start 2023-06-09T04:38:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9350df1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f934c0aed90 0x7f934c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9350df1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f934c0ca370 0x7f934c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9350df1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c159880 con 0x7f934c0ceae0 2023-06-09T04:38:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9350df1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0ca810 con 0x7f934c0aed90 2023-06-09T04:38:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9350df1700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0cda30 con 0x7f934c0ca370 2023-06-09T04:38:08.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934a59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f934c0aed90 0x7f934c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934ad9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f934c0ceae0 0x7f934c0cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46440/0 (socket says 172.21.15.26:46440) 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934ad9d700 1 -- 172.21.15.26:0/261144145 learned_addr learned my addr 172.21.15.26:0/261144145 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9349d9b700 1 --2- 172.21.15.26:0/261144145 >> v2:172.21.15.104:3300/0 conn(0x7f934c0ca370 0x7f934c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934a59c700 1 -- 172.21.15.26:0/261144145 >> v2:172.21.15.104:3300/0 conn(0x7f934c0ca370 msgr2=0x7f934c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934a59c700 1 --2- 172.21.15.26:0/261144145 >> v2:172.21.15.104:3300/0 conn(0x7f934c0ca370 0x7f934c0ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934a59c700 1 -- 172.21.15.26:0/261144145 >> v1:172.21.15.26:6789/0 conn(0x7f934c0ceae0 legacy=0x7f934c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934a59c700 1 -- 172.21.15.26:0/261144145 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c06cff0 con 0x7f934c0aed90 2023-06-09T04:38:08.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f934959a700 1 -- 172.21.15.26:0/261144145 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976701601 0 0) 0x7f934c159880 con 0x7f934c0ceae0 2023-06-09T04:38:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.177+0000 7f9349d9b700 1 --2- 172.21.15.26:0/261144145 >> v2:172.21.15.104:3300/0 conn(0x7f934c0ca370 0x7f934c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f934a59c700 1 --2- 172.21.15.26:0/261144145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0aed90 0x7f934c0c9e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f934c0724d0 tx=0x7f9340009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42841dc9d5700392 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f934959a700 1 -- 172.21.15.26:0/261144145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340005e30 con 0x7f934c0aed90 2023-06-09T04:38:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f934959a700 1 -- 172.21.15.26:0/261144145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340006030 con 0x7f934c0aed90 2023-06-09T04:38:08.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f934959a700 1 -- 172.21.15.26:0/261144145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93400063c0 con 0x7f934c0aed90 2023-06-09T04:38:08.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 -- 172.21.15.26:0/261144145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0aed90 msgr2=0x7f934c0c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 --2- 172.21.15.26:0/261144145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0aed90 0x7f934c0c9e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f934c0724d0 tx=0x7f9340009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 -- 172.21.15.26:0/261144145 shutdown_connections 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 --2- 172.21.15.26:0/261144145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0aed90 0x7f934c0c9e30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 --2- 172.21.15.26:0/261144145 >> v2:172.21.15.104:3300/0 conn(0x7f934c0ca370 0x7f934c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 -- 172.21.15.26:0/261144145 >> 172.21.15.26:0/261144145 conn(0x7f934c098a30 msgr2=0x7f934c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 -- 172.21.15.26:0/261144145 shutdown_connections 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.178+0000 7f9350df1700 1 -- 172.21.15.26:0/261144145 wait complete. 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.180+0000 7f9350df1700 1 Processor -- start 2023-06-09T04:38:08.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.180+0000 7f9350df1700 1 -- start start 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.180+0000 7f9350df1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f934c0aed90 0x7f934c1e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.180+0000 7f9350df1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 0x7f934c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9350df1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f934c0ceae0 0x7f934c1e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9350df1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c154e50 con 0x7f934c0ca370 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9350df1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c155130 con 0x7f934c0aed90 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9350df1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c155410 con 0x7f934c0ceae0 2023-06-09T04:38:08.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 0x7f934c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 0x7f934c154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37586/0 (socket says 172.21.15.26:37586) 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 -- 172.21.15.26:0/2242069281 learned_addr learned my addr 172.21.15.26:0/2242069281 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f934a59c700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f934c0aed90 0x7f934c1e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f934ad9d700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f934c0ceae0 0x7f934c1e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 -- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f934c0ceae0 msgr2=0x7f934c1e28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f934c0ceae0 0x7f934c1e28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 -- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f934c0aed90 msgr2=0x7f934c1e1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f934c0aed90 0x7f934c1e1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 -- 172.21.15.26:0/2242069281 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009430 con 0x7f934c0ca370 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f934a59c700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f934c0aed90 0x7f934c1e1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9349d9b700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 0x7f934c154570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c7f0 tx=0x7f933c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c011800 con 0x7f934c0ca370 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c011960 con 0x7f934c0ca370 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c1e3860 con 0x7f934c0ca370 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c011d10 con 0x7f934c0ca370 2023-06-09T04:38:08.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.181+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c154ab0 con 0x7f934c0ca370 2023-06-09T04:38:08.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.182+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c155630 con 0x7f934c0ca370 2023-06-09T04:38:08.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.183+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f933c018360 con 0x7f934c0ca370 2023-06-09T04:38:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.183+0000 7f933affd700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f932c06ace0 0x7f932c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.183+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f933c089080 con 0x7f934c0ca370 2023-06-09T04:38:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.183+0000 7f934a59c700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f932c06ace0 0x7f932c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.184+0000 7f934a59c700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f932c06ace0 0x7f932c06d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9340009b70 tx=0x7f9340008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.187+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f933c054510 con 0x7f934c0ca370 2023-06-09T04:38:08.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.387+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f934c1e3a50 con 0x7f934c0ca370 2023-06-09T04:38:08.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.388+0000 7f933affd700 1 -- 172.21.15.26:0/2242069281 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f933c057b30 con 0x7f934c0ca370 2023-06-09T04:38:08.389 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:08.389 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "rbd" 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 2, 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-06-09T04:38:08.390 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:38:08.391 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-06-09T04:38:08.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f932c06ace0 msgr2=0x7f932c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f932c06ace0 0x7f932c06d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9340009b70 tx=0x7f9340008070 comp rx=0 tx=0).stop 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 msgr2=0x7f934c154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 0x7f934c154570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c7f0 tx=0x7f933c00cbb0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 shutdown_connections 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f934c0ceae0 0x7f934c1e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f934c0aed90 0x7f934c1e1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f932c06ace0 0x7f932c06d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 --2- 172.21.15.26:0/2242069281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f934c0ca370 0x7f934c154570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 >> 172.21.15.26:0/2242069281 conn(0x7f934c098a30 msgr2=0x7f934c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 shutdown_connections 2023-06-09T04:38:08.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.390+0000 7f9350df1700 1 -- 172.21.15.26:0/2242069281 wait complete. 2023-06-09T04:38:08.403 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:38:08.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:38:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.531+0000 7f39f7d81700 1 Processor -- start 2023-06-09T04:38:08.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.531+0000 7f39f7d81700 1 -- start start 2023-06-09T04:38:08.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f7d81700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f39f00aed00 0x7f39f00cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f7d81700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39f015cb90 0x7f39f00ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f7d81700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f01594f0 con 0x7f39f00cee10 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f7d81700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00cd830 con 0x7f39f015cb90 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f7d81700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00cdb10 con 0x7f39f00aed00 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39f015cb90 0x7f39f00ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f39f015cb90 0x7f39f00ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37594/0 (socket says 172.21.15.26:37594) 2023-06-09T04:38:08.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 -- 172.21.15.26:0/772988874 learned_addr learned my addr 172.21.15.26:0/772988874 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f5b1d700 1 --2- 172.21.15.26:0/772988874 >> v2:172.21.15.104:3300/0 conn(0x7f39f00aed00 0x7f39f00cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 -- 172.21.15.26:0/772988874 >> v2:172.21.15.104:3300/0 conn(0x7f39f00aed00 msgr2=0x7f39f00cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 --2- 172.21.15.26:0/772988874 >> v2:172.21.15.104:3300/0 conn(0x7f39f00aed00 0x7f39f00cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 -- 172.21.15.26:0/772988874 >> v1:172.21.15.26:6789/0 conn(0x7f39f00cee10 legacy=0x7f39f006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 -- 172.21.15.26:0/772988874 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00cddf0 con 0x7f39f015cb90 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f5b1d700 1 --2- 172.21.15.26:0/772988874 >> v2:172.21.15.104:3300/0 conn(0x7f39f00aed00 0x7f39f00cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:08.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f531c700 1 --2- 172.21.15.26:0/772988874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f00ce8d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39f004e2f0 tx=0x7f39ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83b97eb9ffb2cec server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f4b1b700 1 -- 172.21.15.26:0/772988874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00b870 con 0x7f39f015cb90 2023-06-09T04:38:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f4b1b700 1 -- 172.21.15.26:0/772988874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00b9d0 con 0x7f39f015cb90 2023-06-09T04:38:08.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.532+0000 7f39f4b1b700 1 -- 172.21.15.26:0/772988874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00bd60 con 0x7f39f015cb90 2023-06-09T04:38:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 -- 172.21.15.26:0/772988874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 msgr2=0x7f39f00ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 --2- 172.21.15.26:0/772988874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f00ce8d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39f004e2f0 tx=0x7f39ec009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 -- 172.21.15.26:0/772988874 shutdown_connections 2023-06-09T04:38:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 --2- 172.21.15.26:0/772988874 >> v2:172.21.15.104:3300/0 conn(0x7f39f00aed00 0x7f39f00cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 --2- 172.21.15.26:0/772988874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f00ce8d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 -- 172.21.15.26:0/772988874 >> 172.21.15.26:0/772988874 conn(0x7f39f006b7e0 msgr2=0x7f39f00cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 -- 172.21.15.26:0/772988874 shutdown_connections 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.533+0000 7f39f7d81700 1 -- 172.21.15.26:0/772988874 wait complete. 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.535+0000 7f39f7d81700 1 Processor -- start 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.535+0000 7f39f7d81700 1 -- start start 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39f00aed00 0x7f39f00c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39f00cee10 0x7f39f014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f0148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00c2e30 con 0x7f39f015cb90 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f014d2c0 con 0x7f39f00cee10 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f014d5a0 con 0x7f39f00aed00 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f0148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f0148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37602/0 (socket says 172.21.15.26:37602) 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 -- 172.21.15.26:0/937034353 learned_addr learned my addr 172.21.15.26:0/937034353 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:08.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f5b1d700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39f00aed00 0x7f39f00c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f531c700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39f00cee10 0x7f39f014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 -- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39f00aed00 msgr2=0x7f39f00c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39f00aed00 0x7f39f00c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 -- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39f00cee10 msgr2=0x7f39f014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39f00cee10 0x7f39f014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 -- 172.21.15.26:0/937034353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009550 con 0x7f39f015cb90 2023-06-09T04:38:08.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f631e700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f0148860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39e800cc50 tx=0x7f39e800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8003c00 con 0x7f39f015cb90 2023-06-09T04:38:08.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8003d60 con 0x7f39f015cb90 2023-06-09T04:38:08.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f014d880 con 0x7f39f015cb90 2023-06-09T04:38:08.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.536+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e800aab0 con 0x7f39f015cb90 2023-06-09T04:38:08.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.537+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f00c5780 con 0x7f39f015cb90 2023-06-09T04:38:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.538+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f00c5910 con 0x7f39f015cb90 2023-06-09T04:38:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.538+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39e800ac10 con 0x7f39f015cb90 2023-06-09T04:38:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.538+0000 7f39e67fc700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.538+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f39e8088ec0 con 0x7f39f015cb90 2023-06-09T04:38:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.538+0000 7f39f5b1d700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.539+0000 7f39f5b1d700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f39d406ace0 0x7f39d406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39e00099d0 tx=0x7f39e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.543+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f39e8054350 con 0x7f39f015cb90 2023-06-09T04:38:08.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:08.744+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f39f01594f0 con 0x7f39f015cb90 2023-06-09T04:38:09.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.476+0000 7f39e67fc700 1 -- 172.21.15.26:0/937034353 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f39f01594f0 con 0x7f39f015cb90 2023-06-09T04:38:09.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f39d406ace0 msgr2=0x7f39d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f39d406ace0 0x7f39d406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39e00099d0 tx=0x7f39e0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 msgr2=0x7f39f0148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f0148860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39e800cc50 tx=0x7f39e800cf60 comp rx=0 tx=0).stop 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 shutdown_connections 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39f015cb90 0x7f39f0148860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39f00aed00 0x7f39f00c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 --2- 172.21.15.26:0/937034353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39f00cee10 0x7f39f014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 >> 172.21.15.26:0/937034353 conn(0x7f39f006b7e0 msgr2=0x7f39f00ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 shutdown_connections 2023-06-09T04:38:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.479+0000 7f39f7d81700 1 -- 172.21.15.26:0/937034353 wait complete. 2023-06-09T04:38:09.482 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-06-09T04:38:09.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:38:09.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.636+0000 7fe6a33a0700 1 Processor -- start 2023-06-09T04:38:09.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.637+0000 7fe6a33a0700 1 -- start start 2023-06-09T04:38:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.637+0000 7fe6a33a0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c15a340 0x7fe69c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.637+0000 7fe6a33a0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe69c0ce4b0 0x7fe69c0ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.637+0000 7fe6a33a0700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c0cee40 con 0x7fe69c0b0140 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.637+0000 7fe6a33a0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c15a710 con 0x7fe69c0ce4b0 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a33a0700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0d08b0 con 0x7fe69c15a340 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe69c0ce4b0 0x7fe69c0ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe69c0ce4b0 0x7fe69c0ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37606/0 (socket says 172.21.15.26:37606) 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 -- 172.21.15.26:0/350439723 learned_addr learned my addr 172.21.15.26:0/350439723 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:09.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a113c700 1 --2- 172.21.15.26:0/350439723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c15a340 0x7fe69c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 -- 172.21.15.26:0/350439723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c15a340 msgr2=0x7fe69c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 --2- 172.21.15.26:0/350439723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c15a340 0x7fe69c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 -- 172.21.15.26:0/350439723 >> v1:172.21.15.104:6789/0 conn(0x7fe69c0b0140 legacy=0x7fe69c0ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 -- 172.21.15.26:0/350439723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0b0d20 con 0x7fe69c0ce4b0 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe6a093b700 1 --2- 172.21.15.26:0/350439723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c0ce4b0 0x7fe69c0ce900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6980098f0 tx=0x7fe698009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a749a37f0b4f24 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe693fff700 1 -- 172.21.15.26:0/350439723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69800b8a0 con 0x7fe69c0ce4b0 2023-06-09T04:38:09.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe693fff700 1 -- 172.21.15.26:0/350439723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69800ba00 con 0x7fe69c0ce4b0 2023-06-09T04:38:09.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.638+0000 7fe693fff700 1 -- 172.21.15.26:0/350439723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69800bd90 con 0x7fe69c0ce4b0 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 -- 172.21.15.26:0/350439723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c0ce4b0 msgr2=0x7fe69c0ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/350439723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c0ce4b0 0x7fe69c0ce900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6980098f0 tx=0x7fe698009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 -- 172.21.15.26:0/350439723 shutdown_connections 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/350439723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c15a340 0x7fe69c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/350439723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c0ce4b0 0x7fe69c0ce900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 -- 172.21.15.26:0/350439723 >> 172.21.15.26:0/350439723 conn(0x7fe69c089fc0 msgr2=0x7fe69c08a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 -- 172.21.15.26:0/350439723 shutdown_connections 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.639+0000 7fe6a33a0700 1 -- 172.21.15.26:0/350439723 wait complete. 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.640+0000 7fe6a33a0700 1 Processor -- start 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.640+0000 7fe6a33a0700 1 -- start start 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a33a0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe69c0b0140 0x7fe69c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a33a0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c0ce4b0 0x7fe69c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a33a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 0x7fe69c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a33a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c06c540 con 0x7fe69c15a340 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a33a0700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c06af60 con 0x7fe69c0b0140 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a33a0700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c06b240 con 0x7fe69c0ce4b0 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 0x7fe69c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a113c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe69c0b0140 0x7fe69c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 0x7fe69c0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37614/0 (socket says 172.21.15.26:37614) 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 -- 172.21.15.26:0/3163830470 learned_addr learned my addr 172.21.15.26:0/3163830470 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a113c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe69c0b0140 0x7fe69c1553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:44730/0 (socket says 172.21.15.26:44730) 2023-06-09T04:38:09.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a093b700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c0ce4b0 0x7fe69c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 -- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c0ce4b0 msgr2=0x7fe69c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c0ce4b0 0x7fe69c06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 -- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe69c0b0140 msgr2=0x7fe69c1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.641+0000 7fe6a193d700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe69c0b0140 0x7fe69c1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe6a193d700 1 -- 172.21.15.26:0/3163830470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe698009550 con 0x7fe69c15a340 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe6a193d700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 0x7fe69c0cbdc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe69400cb50 tx=0x7fe69400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694003c00 con 0x7fe69c15a340 2023-06-09T04:38:09.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694003d60 con 0x7fe69c15a340 2023-06-09T04:38:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c06b520 con 0x7fe69c15a340 2023-06-09T04:38:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400aa20 con 0x7fe69c15a340 2023-06-09T04:38:09.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.642+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c06bae0 con 0x7fe69c15a340 2023-06-09T04:38:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.643+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c06ceb0 con 0x7fe69c15a340 2023-06-09T04:38:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.644+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe69400ab80 con 0x7fe69c15a340 2023-06-09T04:38:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.644+0000 7fe691ffb700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe68006ace0 0x7fe68006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.644+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe6940890d0 con 0x7fe69c15a340 2023-06-09T04:38:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.644+0000 7fe6a113c700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe68006ace0 0x7fe68006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.645+0000 7fe6a113c700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe68006ace0 0x7fe68006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe68c006fd0 tx=0x7fe68c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.649+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe694054360 con 0x7fe69c15a340 2023-06-09T04:38:09.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:09.845+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe69c0cee40 con 0x7fe69c15a340 2023-06-09T04:38:10.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.482+0000 7fe691ffb700 1 -- 172.21.15.26:0/3163830470 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe69c0cee40 con 0x7fe69c15a340 2023-06-09T04:38:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe68006ace0 msgr2=0x7fe68006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe68006ace0 0x7fe68006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe68c006fd0 tx=0x7fe68c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 msgr2=0x7fe69c0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 0x7fe69c0cbdc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe69400cb50 tx=0x7fe69400ce60 comp rx=0 tx=0).stop 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 shutdown_connections 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe68006ace0 0x7fe68006d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe69c15a340 0x7fe69c0cbdc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe69c0b0140 0x7fe69c1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 --2- 172.21.15.26:0/3163830470 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe69c0ce4b0 0x7fe69c06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 >> 172.21.15.26:0/3163830470 conn(0x7fe69c089fc0 msgr2=0x7fe69c159250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.490+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 shutdown_connections 2023-06-09T04:38:10.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.491+0000 7fe6a33a0700 1 -- 172.21.15.26:0/3163830470 wait complete. 2023-06-09T04:38:10.500 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-06-09T04:38:10.516 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:38:10.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.647+0000 7f3b32487700 1 Processor -- start 2023-06-09T04:38:10.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.647+0000 7f3b32487700 1 -- start start 2023-06-09T04:38:10.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b32487700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0ae920 0x7f3b2c06a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b32487700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b2c0aecf0 0x7f3b2c15ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b32487700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c069db0 con 0x7f3b2c1604a0 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b32487700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c06ad40 con 0x7f3b2c0aecf0 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b32487700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1609b0 con 0x7f3b2c0ae920 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b2c0aecf0 0x7f3b2c15ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b30a24700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3b2c1604a0 0x7f3b2c06e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46480/0 (socket says 172.21.15.26:46480) 2023-06-09T04:38:10.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b30a24700 1 -- 172.21.15.26:0/2368511325 learned_addr learned my addr 172.21.15.26:0/2368511325 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2bfff700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0ae920 0x7f3b2c06a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2b7fe700 1 -- 172.21.15.26:0/2368511325 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0ae920 msgr2=0x7f3b2c06a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0ae920 0x7f3b2c06a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2b7fe700 1 -- 172.21.15.26:0/2368511325 >> v1:172.21.15.26:6789/0 conn(0x7f3b2c1604a0 legacy=0x7f3b2c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2b7fe700 1 -- 172.21.15.26:0/2368511325 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c160c90 con 0x7f3b2c0aecf0 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2affd700 1 -- 172.21.15.26:0/2368511325 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810085083 0 0) 0x7f3b2c069db0 con 0x7f3b2c1604a0 2023-06-09T04:38:10.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2bfff700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0ae920 0x7f3b2c06a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:10.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0aecf0 0x7f3b2c15ff60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009840 tx=0x7f3b14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc042f70fdb780c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2affd700 1 -- 172.21.15.26:0/2368511325 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14011830 con 0x7f3b2c0aecf0 2023-06-09T04:38:10.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2affd700 1 -- 172.21.15.26:0/2368511325 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14011990 con 0x7f3b2c0aecf0 2023-06-09T04:38:10.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.648+0000 7f3b2affd700 1 -- 172.21.15.26:0/2368511325 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14011d20 con 0x7f3b2c0aecf0 2023-06-09T04:38:10.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 -- 172.21.15.26:0/2368511325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0aecf0 msgr2=0x7f3b2c15ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0aecf0 0x7f3b2c15ff60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009840 tx=0x7f3b14009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:10.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 -- 172.21.15.26:0/2368511325 shutdown_connections 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0ae920 0x7f3b2c06a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 --2- 172.21.15.26:0/2368511325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0aecf0 0x7f3b2c15ff60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 -- 172.21.15.26:0/2368511325 >> 172.21.15.26:0/2368511325 conn(0x7f3b2c098b50 msgr2=0x7f3b2c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 -- 172.21.15.26:0/2368511325 shutdown_connections 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.649+0000 7f3b32487700 1 -- 172.21.15.26:0/2368511325 wait complete. 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.651+0000 7f3b32487700 1 Processor -- start 2023-06-09T04:38:10.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.651+0000 7f3b32487700 1 -- start start 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 0x7f3b2c0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0aecf0 0x7f3b2c1f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b2c1604a0 0x7f3b2c1f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1f2e90 con 0x7f3b2c0ae920 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1f3150 con 0x7f3b2c1604a0 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1f3430 con 0x7f3b2c0aecf0 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 0x7f3b2c0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 0x7f3b2c0b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37624/0 (socket says 172.21.15.26:37624) 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 -- 172.21.15.26:0/1106233747 learned_addr learned my addr 172.21.15.26:0/1106233747 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0aecf0 0x7f3b2c1f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b30a24700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b2c1604a0 0x7f3b2c1f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 -- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0aecf0 msgr2=0x7f3b2c1f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0aecf0 0x7f3b2c1f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 -- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b2c1604a0 msgr2=0x7f3b2c1f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b2c1604a0 0x7f3b2c1f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 -- 172.21.15.26:0/1106233747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140094a0 con 0x7f3b2c0ae920 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b2bfff700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 0x7f3b2c0b4060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c7f0 tx=0x7f3b1c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c005c20 con 0x7f3b2c0ae920 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c005d80 con 0x7f3b2c0ae920 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c011820 con 0x7f3b2c0ae920 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.652+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c1f3710 con 0x7f3b2c0ae920 2023-06-09T04:38:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.653+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c1f3cd0 con 0x7f3b2c0ae920 2023-06-09T04:38:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.654+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c067180 con 0x7f3b2c0ae920 2023-06-09T04:38:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.654+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b1c011980 con 0x7f3b2c0ae920 2023-06-09T04:38:10.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.654+0000 7f3b28ff9700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3b0c06ace0 0x7f3b0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.654+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3b1c0896d0 con 0x7f3b2c0ae920 2023-06-09T04:38:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.654+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3b0c06ace0 0x7f3b0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.655+0000 7f3b2b7fe700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3b0c06ace0 0x7f3b0c06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b140090b0 tx=0x7f3b14008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.659+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b1c054870 con 0x7f3b2c0ae920 2023-06-09T04:38:10.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.901+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3b2c0d0640 con 0x7f3b2c0ae920 2023-06-09T04:38:10.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.906+0000 7f3b28ff9700 1 -- 172.21.15.26:0/1106233747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3b1c057e90 con 0x7f3b2c0ae920 2023-06-09T04:38:10.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3b0c06ace0 msgr2=0x7f3b0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3b0c06ace0 0x7f3b0c06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b140090b0 tx=0x7f3b14008030 comp rx=0 tx=0).stop 2023-06-09T04:38:10.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 msgr2=0x7f3b2c0b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 0x7f3b2c0b4060 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c7f0 tx=0x7f3b1c00cbb0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 shutdown_connections 2023-06-09T04:38:10.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b2c1604a0 0x7f3b2c1f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3b0c06ace0 0x7f3b0c06d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b2c0ae920 0x7f3b2c0b4060 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c7f0 tx=0x7f3b1c00cbb0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 --2- 172.21.15.26:0/1106233747 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b2c0aecf0 0x7f3b2c1f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.924+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 >> 172.21.15.26:0/1106233747 conn(0x7f3b2c098b50 msgr2=0x7f3b2c0ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.926+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 shutdown_connections 2023-06-09T04:38:10.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:10.926+0000 7f3b32487700 1 -- 172.21.15.26:0/1106233747 wait complete. 2023-06-09T04:38:10.928 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 3 and data pool 4 2023-06-09T04:38:10.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.065+0000 7f59ccf82700 1 Processor -- start 2023-06-09T04:38:11.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.065+0000 7f59ccf82700 1 -- start start 2023-06-09T04:38:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59ccf82700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 0x7f59c80ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59ccf82700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c8159880 con 0x7f59c80aed90 2023-06-09T04:38:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59ccf82700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c806cff0 con 0x7f59c80ceae0 2023-06-09T04:38:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59ccf82700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80cda30 con 0x7f59c80ca540 2023-06-09T04:38:11.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59c80aed90 0x7f59c80c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46490/0 (socket says 172.21.15.26:46490) 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c659c700 1 -- 172.21.15.26:0/3013909876 learned_addr learned my addr 172.21.15.26:0/3013909876 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 0x7f59c80ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136102307 0 0) 0x7f59c8159880 con 0x7f59c80aed90 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b00035b0 con 0x7f59c80aed90 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025630337 0 0) 0x7f59c806cff0 con 0x7f59c80ceae0 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c8159880 con 0x7f59c80ceae0 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374912632 0 0) 0x7f59b00035b0 con 0x7f59c80aed90 2023-06-09T04:38:11.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 msgr2=0x7f59c80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 0x7f59c80ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 >> v1:172.21.15.104:6789/0 conn(0x7f59c80ceae0 legacy=0x7f59c806da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80cf250 con 0x7f59c80aed90 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.066+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f59bc0017f0 con 0x7f59c80aed90 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 >> v1:172.21.15.26:6789/0 conn(0x7f59c80aed90 legacy=0x7f59c80c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0003bc0 0x7f59b0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 0x7f59b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80cda30 con 0x7f59b0004850 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bb20 con 0x7f59b0003bc0 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bce0 con 0x7f59c80ca540 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c659c700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0003bc0 0x7f59b0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c6d9d700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 0x7f59b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 -- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 msgr2=0x7f59b0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80ca540 0x7f59b0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 -- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0003bc0 msgr2=0x7f59b0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59b0003bc0 0x7f59b0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 -- 172.21.15.26:0/3013909876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00035b0 con 0x7f59b0004850 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59b0004cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009b30 tx=0x7f59b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a6d15c815c9816 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e6c0 con 0x7f59b0004850 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800e820 con 0x7f59b0004850 2023-06-09T04:38:11.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.067+0000 7f59c559a700 1 -- 172.21.15.26:0/3013909876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800eb90 con 0x7f59b0004850 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59ccf82700 1 -- 172.21.15.26:0/3013909876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 msgr2=0x7f59b0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3013909876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59b0004cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009b30 tx=0x7f59b0005880 comp rx=0 tx=0).stop 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59c6d9d700 1 -- 172.21.15.26:0/3013909876 reap_dead start 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59ccf82700 1 -- 172.21.15.26:0/3013909876 shutdown_connections 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59ccf82700 1 -- 172.21.15.26:0/3013909876 >> 172.21.15.26:0/3013909876 conn(0x7f59c8098a30 msgr2=0x7f59c80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59ccf82700 1 -- 172.21.15.26:0/3013909876 shutdown_connections 2023-06-09T04:38:11.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.068+0000 7f59ccf82700 1 -- 172.21.15.26:0/3013909876 wait complete. 2023-06-09T04:38:11.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.070+0000 7f59ccf82700 1 Processor -- start 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.070+0000 7f59ccf82700 1 -- start start 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59c80c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59c81ef920 0x7f59c8156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80b0f30 0x7f59c815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b13d0 con 0x7f59b0004850 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80af160 con 0x7f59c81ef920 2023-06-09T04:38:11.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81e3c10 con 0x7f59c80b0f30 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59c80c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59c80c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37644/0 (socket says 172.21.15.26:37644) 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 -- 172.21.15.26:0/3409544355 learned_addr learned my addr 172.21.15.26:0/3409544355 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59c81ef920 0x7f59c8156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 -- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80b0f30 msgr2=0x7f59c815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80b0f30 0x7f59c815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 -- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59c81ef920 msgr2=0x7f59c8156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59c81ef920 0x7f59c8156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 -- 172.21.15.26:0/3409544355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80b15c0 con 0x7f59b0004850 2023-06-09T04:38:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59c81ef920 0x7f59c8156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59c659c700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59c80c79f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59bc001920 tx=0x7f59bc00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0017c0 con 0x7f59b0004850 2023-06-09T04:38:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc0072e0 con 0x7f59b0004850 2023-06-09T04:38:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc007650 con 0x7f59b0004850 2023-06-09T04:38:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c80b18a0 con 0x7f59b0004850 2023-06-09T04:38:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.071+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80b1e60 con 0x7f59b0004850 2023-06-09T04:38:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.072+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c81efcf0 con 0x7f59b0004850 2023-06-09T04:38:11.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.073+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59bc005830 con 0x7f59b0004850 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.073+0000 7f59b6ffd700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.073+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59bc089390 con 0x7f59b0004850 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.073+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.074+0000 7f59c5d9b700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59a806ace0 0x7f59a806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59c806f290 tx=0x7f59b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.078+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59bc057ed0 con 0x7f59b0004850 2023-06-09T04:38:11.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.277+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c8067180 con 0x7f59b0004850 2023-06-09T04:38:11.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.278+0000 7f59b6ffd700 1 -- 172.21.15.26:0/3409544355 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18222 (secure 0 0 0) 0x7f59bc057a60 con 0x7f59b0004850 2023-06-09T04:38:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:11.280 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:10.903344+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:11.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59a806ace0 msgr2=0x7f59a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59a806ace0 0x7f59a806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59c806f290 tx=0x7f59b8008030 comp rx=0 tx=0).stop 2023-06-09T04:38:11.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 msgr2=0x7f59c80c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59c80c79f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59bc001920 tx=0x7f59bc00fb00 comp rx=0 tx=0).stop 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 shutdown_connections 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59c80b0f30 0x7f59c815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59b0004850 0x7f59c80c79f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 --2- 172.21.15.26:0/3409544355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59c81ef920 0x7f59c8156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 >> 172.21.15.26:0/3409544355 conn(0x7f59c8098a30 msgr2=0x7f59c80cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 shutdown_connections 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.281+0000 7f59ccf82700 1 -- 172.21.15.26:0/3409544355 wait complete. 2023-06-09T04:38:11.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:11.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.418+0000 7f87ff5d9700 1 Processor -- start 2023-06-09T04:38:11.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.418+0000 7f87ff5d9700 1 -- start start 2023-06-09T04:38:11.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87ff5d9700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f87f806b2b0 0x7f87f80cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87ff5d9700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87ff5d9700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f8071ad0 con 0x7f87f815c200 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87ff5d9700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f80718c0 con 0x7f87f806b2b0 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87ff5d9700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8070b40 con 0x7f87f80ce8d0 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87fcb74700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f87f806b2b0 0x7f87f80cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87fdb76700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87fd375700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f87f815c200 0x7f87f80ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:45422/0 (socket says 172.21.15.26:45422) 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87fcb74700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f87f806b2b0 0x7f87f80cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:44774/0 (socket says 172.21.15.26:44774) 2023-06-09T04:38:11.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.419+0000 7f87fd375700 1 -- 172.21.15.26:0/3615632964 learned_addr learned my addr 172.21.15.26:0/3615632964 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87fcb74700 1 -- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 msgr2=0x7f87f806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87fcb74700 1 --2- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87fcb74700 1 -- 172.21.15.26:0/3615632964 >> v1:172.21.15.104:6789/0 conn(0x7f87f815c200 legacy=0x7f87f80ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87fcb74700 1 -- 172.21.15.26:0/3615632964 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8070e20 con 0x7f87f806b2b0 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87ebfff700 1 -- 172.21.15.26:0/3615632964 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47651206 0 0) 0x7f87f8071ad0 con 0x7f87f815c200 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87fcb74700 1 --2- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f806b2b0 0x7f87f80cb470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009840 tx=0x7f87f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d01cfc64fdb0f79 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87ebfff700 1 -- 172.21.15.26:0/3615632964 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011830 con 0x7f87f806b2b0 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87ebfff700 1 -- 172.21.15.26:0/3615632964 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4011990 con 0x7f87f806b2b0 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87ebfff700 1 -- 172.21.15.26:0/3615632964 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011d20 con 0x7f87f806b2b0 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87ff5d9700 1 -- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f806b2b0 msgr2=0x7f87f80cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.420+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f806b2b0 0x7f87f80cb470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009840 tx=0x7f87f4009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.421+0000 7f87ff5d9700 1 -- 172.21.15.26:0/3615632964 shutdown_connections 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.421+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.421+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/3615632964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f806b2b0 0x7f87f80cb470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.421+0000 7f87ff5d9700 1 -- 172.21.15.26:0/3615632964 >> 172.21.15.26:0/3615632964 conn(0x7f87f80cb9d0 msgr2=0x7f87f80cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.421+0000 7f87ff5d9700 1 -- 172.21.15.26:0/3615632964 shutdown_connections 2023-06-09T04:38:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.421+0000 7f87ff5d9700 1 -- 172.21.15.26:0/3615632964 wait complete. 2023-06-09T04:38:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.422+0000 7f87ff5d9700 1 Processor -- start 2023-06-09T04:38:11.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.422+0000 7f87ff5d9700 1 -- start start 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87ff5d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 0x7f87f80c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87ff5d9700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f81422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87ff5d9700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f815c200 0x7f87f80c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87ff5d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c4580 con 0x7f87f806b2b0 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87ff5d9700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f81f1e90 con 0x7f87f815c200 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87ff5d9700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80b4bb0 con 0x7f87f80ce8d0 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 0x7f87f80c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 0x7f87f80c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37658/0 (socket says 172.21.15.26:37658) 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 -- 172.21.15.26:0/1860179288 learned_addr learned my addr 172.21.15.26:0/1860179288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fcb74700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f81422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fdb76700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f815c200 0x7f87f80c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 -- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 msgr2=0x7f87f81422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f81422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 -- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f815c200 msgr2=0x7f87f80c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f815c200 0x7f87f80c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 -- 172.21.15.26:0/1860179288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40094a0 con 0x7f87f806b2b0 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87fd375700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 0x7f87f80c3d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0011e0 tx=0x7f87ec00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec004c80 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.423+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec004e00 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.424+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec007310 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.424+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f80b14e0 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.424+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f80b17c0 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.425+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f80c4750 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.425+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87ec007470 con 0x7f87f806b2b0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.425+0000 7f87e9ffb700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f87dc06ace0 0x7f87dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.425+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87ec0891e0 con 0x7f87f806b2b0 2023-06-09T04:38:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.425+0000 7f87fcb74700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f87dc06ace0 0x7f87dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.426+0000 7f87fcb74700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f87dc06ace0 0x7f87dc06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87f40090b0 tx=0x7f87f401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.430+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87f80c4750 con 0x7f87f806b2b0 2023-06-09T04:38:11.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.630+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87f8067180 con 0x7f87f806b2b0 2023-06-09T04:38:11.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.631+0000 7f87e9ffb700 1 -- 172.21.15.26:0/1860179288 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18222 (secure 0 0 0) 0x7f87ec054320 con 0x7f87f806b2b0 2023-06-09T04:38:11.632 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:11.633 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:10.903344+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:11.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f87dc06ace0 msgr2=0x7f87dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f87dc06ace0 0x7f87dc06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87f40090b0 tx=0x7f87f401c040 comp rx=0 tx=0).stop 2023-06-09T04:38:11.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 msgr2=0x7f87f80c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 0x7f87f80c3d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0011e0 tx=0x7f87ec00cae0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 shutdown_connections 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87f815c200 0x7f87f80c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f87dc06ace0 0x7f87dc06d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87f806b2b0 0x7f87f80c3d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 --2- 172.21.15.26:0/1860179288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f87f80ce8d0 0x7f87f81422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 >> 172.21.15.26:0/1860179288 conn(0x7f87f80cb9d0 msgr2=0x7f87f815cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.633+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 shutdown_connections 2023-06-09T04:38:11.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.634+0000 7f87ff5d9700 1 -- 172.21.15.26:0/1860179288 wait complete. 2023-06-09T04:38:11.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:38:11.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 Processor -- start 2023-06-09T04:38:11.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 -- start start 2023-06-09T04:38:11.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa03015d3e0 0x7fa0300d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0300d1300 0x7fa0300b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03015d950 con 0x7fa0301569b0 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300d0970 con 0x7fa03015d3e0 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.773+0000 7fa0359ee700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300cd360 con 0x7fa0300d1300 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa03015d3e0 0x7fa0300d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa0301569b0 0x7fa0300cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46524/0 (socket says 172.21.15.26:46524) 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02effd700 1 -- 172.21.15.26:0/3888252148 learned_addr learned my addr 172.21.15.26:0/3888252148 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02f7fe700 1 --2- 172.21.15.26:0/3888252148 >> v2:172.21.15.104:3300/0 conn(0x7fa0300d1300 0x7fa0300b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3888252148 >> v2:172.21.15.104:3300/0 conn(0x7fa0300d1300 msgr2=0x7fa0300b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02e7fc700 1 --2- 172.21.15.26:0/3888252148 >> v2:172.21.15.104:3300/0 conn(0x7fa0300d1300 0x7fa0300b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3888252148 >> v1:172.21.15.26:6789/0 conn(0x7fa0301569b0 legacy=0x7fa0300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3888252148 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300cd640 con 0x7fa03015d3e0 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02dffb700 1 -- 172.21.15.26:0/3888252148 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024715880 0 0) 0x7fa03015d950 con 0x7fa0301569b0 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02e7fc700 1 --2- 172.21.15.26:0/3888252148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03015d3e0 0x7fa0300d0dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa03008bf80 tx=0x7fa024009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934c226b09a11690 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02dffb700 1 -- 172.21.15.26:0/3888252148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024011830 con 0x7fa03015d3e0 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02dffb700 1 -- 172.21.15.26:0/3888252148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024011990 con 0x7fa03015d3e0 2023-06-09T04:38:11.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.774+0000 7fa02dffb700 1 -- 172.21.15.26:0/3888252148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024011d20 con 0x7fa03015d3e0 2023-06-09T04:38:11.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 -- 172.21.15.26:0/3888252148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03015d3e0 msgr2=0x7fa0300d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3888252148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03015d3e0 0x7fa0300d0dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa03008bf80 tx=0x7fa024009b20 comp rx=0 tx=0).stop 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 -- 172.21.15.26:0/3888252148 shutdown_connections 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3888252148 >> v2:172.21.15.104:3300/0 conn(0x7fa0300d1300 0x7fa0300b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3888252148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa03015d3e0 0x7fa0300d0dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 -- 172.21.15.26:0/3888252148 >> 172.21.15.26:0/3888252148 conn(0x7fa03006b1f0 msgr2=0x7fa03006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 -- 172.21.15.26:0/3888252148 shutdown_connections 2023-06-09T04:38:11.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.775+0000 7fa0359ee700 1 -- 172.21.15.26:0/3888252148 wait complete. 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.776+0000 7fa0359ee700 1 Processor -- start 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.776+0000 7fa0359ee700 1 -- start start 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa0359ee700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0300d1300 0x7fa03014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa0359ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 0x7fa0300c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa0359ee700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0300c8e20 0x7fa0300714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa0359ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300b5a10 con 0x7fa0301569b0 2023-06-09T04:38:11.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa0359ee700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300c93a0 con 0x7fa0300c8e20 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa0359ee700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300b5c60 con 0x7fa0300d1300 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 0x7fa0300c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 0x7fa0300c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37674/0 (socket says 172.21.15.26:37674) 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3589420958 learned_addr learned my addr 172.21.15.26:0/3589420958 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02f7fe700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0300c8e20 0x7fa0300714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02effd700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0300d1300 0x7fa03014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0300d1300 msgr2=0x7fa03014d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0300d1300 0x7fa03014d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0300c8e20 msgr2=0x7fa0300714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0300c8e20 0x7fa0300714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 -- 172.21.15.26:0/3589420958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240094a0 con 0x7fa0301569b0 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02effd700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0300d1300 0x7fa03014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02f7fe700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0300c8e20 0x7fa0300714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.777+0000 7fa02e7fc700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 0x7fa0300c88e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa0240090b0 tx=0x7fa024004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.778+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0240036a0 con 0x7fa0301569b0 2023-06-09T04:38:11.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.778+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02401f070 con 0x7fa0301569b0 2023-06-09T04:38:11.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.778+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024003a20 con 0x7fa0301569b0 2023-06-09T04:38:11.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.778+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0300b5f40 con 0x7fa0301569b0 2023-06-09T04:38:11.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.778+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03014e3a0 con 0x7fa0301569b0 2023-06-09T04:38:11.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.779+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0300b6460 con 0x7fa0301569b0 2023-06-09T04:38:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.779+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa024003b80 con 0x7fa0301569b0 2023-06-09T04:38:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.779+0000 7fa017fff700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa01c06ad10 0x7fa01c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.780+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa024021070 con 0x7fa0301569b0 2023-06-09T04:38:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.780+0000 7fa02effd700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa01c06ad10 0x7fa01c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.780+0000 7fa02effd700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa01c06ad10 0x7fa01c06d1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0200010e0 tx=0x7fa020009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:11.784+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0300b6460 con 0x7fa0301569b0 2023-06-09T04:38:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.032+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa0300b6460 con 0x7fa0301569b0 2023-06-09T04:38:12.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.920+0000 7fa017fff700 1 -- 172.21.15.26:0/3589420958 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa0300b6460 con 0x7fa0301569b0 2023-06-09T04:38:12.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa01c06ad10 msgr2=0x7fa01c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa01c06ad10 0x7fa01c06d1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa0200010e0 tx=0x7fa020009040 comp rx=0 tx=0).stop 2023-06-09T04:38:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 msgr2=0x7fa0300c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 0x7fa0300c88e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa0240090b0 tx=0x7fa024004750 comp rx=0 tx=0).stop 2023-06-09T04:38:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 shutdown_connections 2023-06-09T04:38:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0300c8e20 0x7fa0300714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0300d1300 0x7fa03014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa01c06ad10 0x7fa01c06d1c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 --2- 172.21.15.26:0/3589420958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0301569b0 0x7fa0300c88e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 >> 172.21.15.26:0/3589420958 conn(0x7fa03006b1f0 msgr2=0x7fa030160880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 shutdown_connections 2023-06-09T04:38:12.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:12.923+0000 7fa0359ee700 1 -- 172.21.15.26:0/3589420958 wait complete. 2023-06-09T04:38:12.939 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:38:12.939 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:38:13.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.072+0000 7f2628ad2700 1 Processor -- start 2023-06-09T04:38:13.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.072+0000 7f2628ad2700 1 -- start start 2023-06-09T04:38:13.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.073+0000 7f2628ad2700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f26240b0850 0x7f26240b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.073+0000 7f2628ad2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240d08b0 con 0x7f262415a340 2023-06-09T04:38:13.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.073+0000 7f2628ad2700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240b0d20 con 0x7f26240cebc0 2023-06-09T04:38:13.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.073+0000 7f2628ad2700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262415a710 con 0x7f26240b0850 2023-06-09T04:38:13.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.073+0000 7f262259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f262415a340 0x7f26240ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46538/0 (socket says 172.21.15.26:46538) 2023-06-09T04:38:13.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.073+0000 7f262259c700 1 -- 172.21.15.26:0/3966950610 learned_addr learned my addr 172.21.15.26:0/3966950610 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:13.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f2622d9d700 1 --2- 172.21.15.26:0/3966950610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f26240b0850 0x7f26240b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753339792 0 0) 0x7f26240d08b0 con 0x7f262415a340 2023-06-09T04:38:13.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c0035b0 con 0x7f262415a340 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282375792 0 0) 0x7f26240b0d20 con 0x7f26240cebc0 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26240d08b0 con 0x7f26240cebc0 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f2622d9d700 1 -- 172.21.15.26:0/3966950610 >> v1:172.21.15.104:6789/0 conn(0x7f26240cebc0 legacy=0x7f26240b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f2622d9d700 1 -- 172.21.15.26:0/3966950610 >> v1:172.21.15.26:6789/0 conn(0x7f262415a340 legacy=0x7f26240ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f2622d9d700 1 -- 172.21.15.26:0/3966950610 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240b1000 con 0x7f26240b0850 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f2622d9d700 1 --2- 172.21.15.26:0/3966950610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f26240b0850 0x7f26240b1dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f261c009dc0 tx=0x7f261c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e9e7909d1c27f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:13.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00e070 con 0x7f26240b0850 2023-06-09T04:38:13.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00bb20 con 0x7f26240b0850 2023-06-09T04:38:13.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.074+0000 7f262159a700 1 -- 172.21.15.26:0/3966950610 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c012430 con 0x7f26240b0850 2023-06-09T04:38:13.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 -- 172.21.15.26:0/3966950610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f26240b0850 msgr2=0x7f26240b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3966950610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f26240b0850 0x7f26240b1dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f261c009dc0 tx=0x7f261c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:13.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 -- 172.21.15.26:0/3966950610 shutdown_connections 2023-06-09T04:38:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3966950610 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f26240b0850 0x7f26240b1dc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 -- 172.21.15.26:0/3966950610 >> 172.21.15.26:0/3966950610 conn(0x7f2624089fc0 msgr2=0x7f262408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 -- 172.21.15.26:0/3966950610 shutdown_connections 2023-06-09T04:38:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.075+0000 7f2628ad2700 1 -- 172.21.15.26:0/3966950610 wait complete. 2023-06-09T04:38:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.076+0000 7f2628ad2700 1 Processor -- start 2023-06-09T04:38:13.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.076+0000 7f2628ad2700 1 -- start start 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2628ad2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26240b0850 0x7f26240c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2628ad2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 0x7f262406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2628ad2700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f262415a340 0x7f262406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2628ad2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26241560f0 con 0x7f26240cebc0 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2628ad2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26241f1ce0 con 0x7f26240b0850 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2628ad2700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26241f0f20 con 0x7f262415a340 2023-06-09T04:38:13.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2621d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 0x7f262406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2621d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 0x7f262406bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37688/0 (socket says 172.21.15.26:37688) 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2621d9b700 1 -- 172.21.15.26:0/3564735494 learned_addr learned my addr 172.21.15.26:0/3564735494 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f262259c700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26240b0850 0x7f26240c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2622d9d700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f262415a340 0x7f262406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2621d9b700 1 -- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f262415a340 msgr2=0x7f262406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.077+0000 7f2621d9b700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f262415a340 0x7f262406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2621d9b700 1 -- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26240b0850 msgr2=0x7f26240c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2621d9b700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26240b0850 0x7f26240c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2621d9b700 1 -- 172.21.15.26:0/3564735494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009a70 con 0x7f26240cebc0 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f262259c700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26240b0850 0x7f26240c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2621d9b700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 0x7f262406bf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f261400c550 tx=0x7f261400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140052d0 con 0x7f26240cebc0 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614005430 con 0x7f26240cebc0 2023-06-09T04:38:13.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26241f1200 con 0x7f26240cebc0 2023-06-09T04:38:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140038c0 con 0x7f26240cebc0 2023-06-09T04:38:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.078+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26241f17c0 con 0x7f26240cebc0 2023-06-09T04:38:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.079+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26240af490 con 0x7f26240cebc0 2023-06-09T04:38:13.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.079+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2614003a20 con 0x7f26240cebc0 2023-06-09T04:38:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.080+0000 7f2612ffd700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f260406ace0 0x7f260406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.080+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26140889e0 con 0x7f26240cebc0 2023-06-09T04:38:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.080+0000 7f262259c700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f260406ace0 0x7f260406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.080+0000 7f262259c700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f260406ace0 0x7f260406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26180010e0 tx=0x7f2618009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:13.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.084+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2614053a80 con 0x7f26240cebc0 2023-06-09T04:38:13.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.332+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f262406fe30 con 0x7f26240cebc0 2023-06-09T04:38:13.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.924+0000 7f2612ffd700 1 -- 172.21.15.26:0/3564735494 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26140570a0 con 0x7f26240cebc0 2023-06-09T04:38:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f260406ace0 msgr2=0x7f260406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f260406ace0 0x7f260406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26180010e0 tx=0x7f2618009040 comp rx=0 tx=0).stop 2023-06-09T04:38:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 msgr2=0x7f262406bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 0x7f262406bf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f261400c550 tx=0x7f261400c910 comp rx=0 tx=0).stop 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 shutdown_connections 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f262415a340 0x7f262406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26240b0850 0x7f26240c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f260406ace0 0x7f260406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 --2- 172.21.15.26:0/3564735494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26240cebc0 0x7f262406bf80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 >> 172.21.15.26:0/3564735494 conn(0x7f2624089fc0 msgr2=0x7f262406ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:13.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 shutdown_connections 2023-06-09T04:38:13.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:13.927+0000 7f2628ad2700 1 -- 172.21.15.26:0/3564735494 wait complete. 2023-06-09T04:38:13.943 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:38:13.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:14.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.073+0000 7f6839189700 1 Processor -- start 2023-06-09T04:38:14.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.073+0000 7f6839189700 1 -- start start 2023-06-09T04:38:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6839189700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 0x7f68340b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6839189700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68340b0850 0x7f68340ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6839189700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68340cee40 con 0x7f68340ce4b0 2023-06-09T04:38:14.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6839189700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683415a710 con 0x7f68340b0850 2023-06-09T04:38:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6839189700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340d08b0 con 0x7f683415a340 2023-06-09T04:38:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f683259c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f68340ce4b0 0x7f68340b0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46554/0 (socket says 172.21.15.26:46554) 2023-06-09T04:38:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f683259c700 1 -- 172.21.15.26:0/1761411870 learned_addr learned my addr 172.21.15.26:0/1761411870 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670622731 0 0) 0x7f6828001110 con 0x7f68340ce4b0 2023-06-09T04:38:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6832d9d700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 0x7f68340b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f683359e700 1 --2- 172.21.15.26:0/1761411870 >> v2:172.21.15.104:3300/0 conn(0x7f68340b0850 0x7f68340ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f681c0035b0 con 0x7f68340ce4b0 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165703381 0 0) 0x7f681c0035b0 con 0x7f68340ce4b0 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 msgr2=0x7f68340b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 0x7f68340b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 >> v2:172.21.15.104:3300/0 conn(0x7f68340b0850 msgr2=0x7f68340ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 --2- 172.21.15.26:0/1761411870 >> v2:172.21.15.104:3300/0 conn(0x7f68340b0850 0x7f68340ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340b0d20 con 0x7f68340ce4b0 2023-06-09T04:38:14.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f6828001800 con 0x7f68340ce4b0 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 >> v1:172.21.15.26:6789/0 conn(0x7f68340ce4b0 legacy=0x7f68340b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 0x7f681c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f681c003fd0 0x7f681c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f681c004d90 0x7f681c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683415a710 con 0x7f681c003fd0 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68340d08b0 con 0x7f681c004d90 2023-06-09T04:38:14.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.074+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681c00ba10 con 0x7f683415a340 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f681c003fd0 0x7f681c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f6832d9d700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 0x7f681c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683359e700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f681c004d90 0x7f681c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 -- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 msgr2=0x7f681c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f683415a340 0x7f681c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 -- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f681c004d90 msgr2=0x7f681c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f681c004d90 0x7f681c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 -- 172.21.15.26:0/1761411870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c0035b0 con 0x7f681c003fd0 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f683259c700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f681c003fd0 0x7f681c004850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f682800c190 tx=0x7f681c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6802622d4927c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828007d00 con 0x7f681c003fd0 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800cc90 con 0x7f681c003fd0 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f6831d9b700 1 -- 172.21.15.26:0/1761411870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828005960 con 0x7f681c003fd0 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f6839189700 1 -- 172.21.15.26:0/1761411870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f681c003fd0 msgr2=0x7f681c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.075+0000 7f6839189700 1 --2- 172.21.15.26:0/1761411870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f681c003fd0 0x7f681c004850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f682800c190 tx=0x7f681c005880 comp rx=0 tx=0).stop 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.076+0000 7f683359e700 1 -- 172.21.15.26:0/1761411870 reap_dead start 2023-06-09T04:38:14.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.076+0000 7f6839189700 1 -- 172.21.15.26:0/1761411870 shutdown_connections 2023-06-09T04:38:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.076+0000 7f6839189700 1 -- 172.21.15.26:0/1761411870 >> 172.21.15.26:0/1761411870 conn(0x7f6834089fc0 msgr2=0x7f683408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.076+0000 7f6839189700 1 -- 172.21.15.26:0/1761411870 shutdown_connections 2023-06-09T04:38:14.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.076+0000 7f6839189700 1 -- 172.21.15.26:0/1761411870 wait complete. 2023-06-09T04:38:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.077+0000 7f6839189700 1 Processor -- start 2023-06-09T04:38:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.077+0000 7f6839189700 1 -- start start 2023-06-09T04:38:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6839189700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f681c003fd0 0x7f68341e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6839189700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68340cd980 0x7f68340b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6839189700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 0x7f68340cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6839189700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68340cc780 con 0x7f68340cbdc0 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6839189700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68341e4610 con 0x7f68340cd980 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6839189700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340b5e70 con 0x7f681c003fd0 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 0x7f68340cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683259c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68340cd980 0x7f68340b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 0x7f68340cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37710/0 (socket says 172.21.15.26:37710) 2023-06-09T04:38:14.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f6832d9d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f681c003fd0 0x7f68341e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 -- 172.21.15.26:0/2658257133 learned_addr learned my addr 172.21.15.26:0/2658257133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 -- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f681c003fd0 msgr2=0x7f68341e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f681c003fd0 0x7f68341e40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 -- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68340cd980 msgr2=0x7f68340b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68340cd980 0x7f68340b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683359e700 1 -- 172.21.15.26:0/2658257133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68341e2740 con 0x7f68340cbdc0 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.078+0000 7f683259c700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68340cd980 0x7f68340b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:14.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.079+0000 7f683359e700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 0x7f68340cc240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68340b0c50 tx=0x7f682c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.079+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00e040 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.079+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00f040 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.079+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00f890 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.079+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68340b5b90 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.079+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683406b2d0 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.080+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68340cfec0 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.080+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f682c00f9f0 con 0x7f68340cbdc0 2023-06-09T04:38:14.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.081+0000 7f681b7fe700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f682006ace0 0x7f682006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.081+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f682c089a30 con 0x7f68340cbdc0 2023-06-09T04:38:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.081+0000 7f6832d9d700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f682006ace0 0x7f682006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.081+0000 7f6832d9d700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f682006ace0 0x7f682006d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6824009b60 tx=0x7f68240091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.085+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f682c054b70 con 0x7f68340cbdc0 2023-06-09T04:38:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.328+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68341e1460 con 0x7f68340cbdc0 2023-06-09T04:38:14.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.328+0000 7f681b7fe700 1 -- 172.21.15.26:0/2658257133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f682c058190 con 0x7f68340cbdc0 2023-06-09T04:38:14.329 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:14.330 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f682006ace0 msgr2=0x7f682006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f682006ace0 0x7f682006d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6824009b60 tx=0x7f68240091c0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 msgr2=0x7f68340cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 0x7f68340cc240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68340b0c50 tx=0x7f682c011ed0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 shutdown_connections 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f682006ace0 0x7f682006d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68340cbdc0 0x7f68340cc240 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f681c003fd0 0x7f68341e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 --2- 172.21.15.26:0/2658257133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68340cd980 0x7f68340b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.330+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 >> 172.21.15.26:0/2658257133 conn(0x7f6834089fc0 msgr2=0x7f68340af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.331+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 shutdown_connections 2023-06-09T04:38:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.331+0000 7f6839189700 1 -- 172.21.15.26:0/2658257133 wait complete. 2023-06-09T04:38:14.333 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:38:14.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.466+0000 7f2fcbf88700 1 Processor -- start 2023-06-09T04:38:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.466+0000 7f2fcbf88700 1 -- start start 2023-06-09T04:38:14.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fcbf88700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2fc41591d0 0x7f2fc41595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fcbf88700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fc40c9c10 0x7f2fc40ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fcbf88700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40ca790 con 0x7f2fc40cd530 2023-06-09T04:38:14.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fcbf88700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4159ae0 con 0x7f2fc40c9c10 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fcbf88700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40ca5a0 con 0x7f2fc41591d0 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fca525700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2fc40cd530 0x7f2fc40cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46576/0 (socket says 172.21.15.26:46576) 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fca525700 1 -- 172.21.15.26:0/407879248 learned_addr learned my addr 172.21.15.26:0/407879248 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fc9523700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fc40c9c10 0x7f2fc40ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.467+0000 7f2fc9d24700 1 --2- 172.21.15.26:0/407879248 >> v2:172.21.15.104:3300/0 conn(0x7f2fc41591d0 0x7f2fc41595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc8d22700 1 -- 172.21.15.26:0/407879248 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194623973 0 0) 0x7f2fc40ca790 con 0x7f2fc40cd530 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc8d22700 1 -- 172.21.15.26:0/407879248 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb00035b0 con 0x7f2fc40cd530 2023-06-09T04:38:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc9523700 1 -- 172.21.15.26:0/407879248 >> v2:172.21.15.104:3300/0 conn(0x7f2fc41591d0 msgr2=0x7f2fc41595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc9523700 1 --2- 172.21.15.26:0/407879248 >> v2:172.21.15.104:3300/0 conn(0x7f2fc41591d0 0x7f2fc41595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc9523700 1 -- 172.21.15.26:0/407879248 >> v1:172.21.15.26:6789/0 conn(0x7f2fc40cd530 legacy=0x7f2fc40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc9523700 1 -- 172.21.15.26:0/407879248 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40caa70 con 0x7f2fc40c9c10 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc9523700 1 --2- 172.21.15.26:0/407879248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc40c9c10 0x7f2fc40ca060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406e6c0 tx=0x7f2fc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9352de92fddbf227 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc8d22700 1 -- 172.21.15.26:0/407879248 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011830 con 0x7f2fc40c9c10 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc8d22700 1 -- 172.21.15.26:0/407879248 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0011990 con 0x7f2fc40c9c10 2023-06-09T04:38:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fc8d22700 1 -- 172.21.15.26:0/407879248 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011d20 con 0x7f2fc40c9c10 2023-06-09T04:38:14.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fcbf88700 1 -- 172.21.15.26:0/407879248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc40c9c10 msgr2=0x7f2fc40ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/407879248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc40c9c10 0x7f2fc40ca060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406e6c0 tx=0x7f2fc0009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fcbf88700 1 -- 172.21.15.26:0/407879248 shutdown_connections 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/407879248 >> v2:172.21.15.104:3300/0 conn(0x7f2fc41591d0 0x7f2fc41595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/407879248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc40c9c10 0x7f2fc40ca060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.468+0000 7f2fcbf88700 1 -- 172.21.15.26:0/407879248 >> 172.21.15.26:0/407879248 conn(0x7f2fc40cb9d0 msgr2=0x7f2fc40cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.469+0000 7f2fcbf88700 1 -- 172.21.15.26:0/407879248 shutdown_connections 2023-06-09T04:38:14.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.469+0000 7f2fcbf88700 1 -- 172.21.15.26:0/407879248 wait complete. 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.470+0000 7f2fcbf88700 1 Processor -- start 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.470+0000 7f2fcbf88700 1 -- start start 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fcbf88700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2fc40c9c10 0x7f2fc41f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fcbf88700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2fc40cd530 0x7f2fc41ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fcbf88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 0x7f2fc406d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fcbf88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41f34c0 con 0x7f2fc41591d0 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fcbf88700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40c3f40 con 0x7f2fc40c9c10 2023-06-09T04:38:14.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fcbf88700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41ef830 con 0x7f2fc40cd530 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fca525700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 0x7f2fc406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fca525700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 0x7f2fc406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37724/0 (socket says 172.21.15.26:37724) 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fca525700 1 -- 172.21.15.26:0/2293675594 learned_addr learned my addr 172.21.15.26:0/2293675594 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fc9d24700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2fc40c9c10 0x7f2fc41f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.471+0000 7f2fc9523700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2fc40cd530 0x7f2fc41ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fca525700 1 -- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2fc40cd530 msgr2=0x7f2fc41ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fca525700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2fc40cd530 0x7f2fc41ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fca525700 1 -- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2fc40c9c10 msgr2=0x7f2fc41f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fca525700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2fc40c9c10 0x7f2fc41f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fca525700 1 -- 172.21.15.26:0/2293675594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00094a0 con 0x7f2fc41591d0 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fc9523700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2fc40cd530 0x7f2fc41ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fca525700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 0x7f2fc406d590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00cb70 tx=0x7f2fbc00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00aa60 con 0x7f2fc41591d0 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00abc0 con 0x7f2fc41591d0 2023-06-09T04:38:14.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc41f36d0 con 0x7f2fc41591d0 2023-06-09T04:38:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc012400 con 0x7f2fc41591d0 2023-06-09T04:38:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.472+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc41f3c90 con 0x7f2fc41591d0 2023-06-09T04:38:14.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.473+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc40c40d0 con 0x7f2fc41591d0 2023-06-09T04:38:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.473+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fbc01b3b0 con 0x7f2fc41591d0 2023-06-09T04:38:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.474+0000 7f2fba7fc700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2fa806ace0 0x7f2fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.474+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fbc089280 con 0x7f2fc41591d0 2023-06-09T04:38:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.474+0000 7f2fc9d24700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2fa806ace0 0x7f2fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.474+0000 7f2fc9d24700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2fa806ace0 0x7f2fa806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c9670 tx=0x7f2fb4009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.478+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fbc0542b0 con 0x7f2fc41591d0 2023-06-09T04:38:14.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.675+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc41f3e80 con 0x7f2fc41591d0 2023-06-09T04:38:14.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.676+0000 7f2fba7fc700 1 -- 172.21.15.26:0/2293675594 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f2fbc0578d0 con 0x7f2fc41591d0 2023-06-09T04:38:14.678 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:14.678 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.678+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2fa806ace0 msgr2=0x7f2fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.678+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2fa806ace0 0x7f2fa806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c9670 tx=0x7f2fb4009210 comp rx=0 tx=0).stop 2023-06-09T04:38:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.678+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 msgr2=0x7f2fc406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.678+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 0x7f2fc406d590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00cb70 tx=0x7f2fbc00ce80 comp rx=0 tx=0).stop 2023-06-09T04:38:14.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.678+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 shutdown_connections 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2fa806ace0 0x7f2fa806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fc41591d0 0x7f2fc406d590 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2fc40c9c10 0x7f2fc41f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 --2- 172.21.15.26:0/2293675594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2fc40cd530 0x7f2fc41ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 >> 172.21.15.26:0/2293675594 conn(0x7f2fc40cb9d0 msgr2=0x7f2fc4069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 shutdown_connections 2023-06-09T04:38:14.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.679+0000 7f2fcbf88700 1 -- 172.21.15.26:0/2293675594 wait complete. 2023-06-09T04:38:14.692 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:38:14.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.815+0000 7f82057d1700 1 Processor -- start 2023-06-09T04:38:14.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.815+0000 7f82057d1700 1 -- start start 2023-06-09T04:38:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f82057d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82000aed50 0x7f8200069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f82057d1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f820006e990 0x7f820006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f82057d1700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820006f190 con 0x7f820015c6e0 2023-06-09T04:38:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f82057d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820006e440 con 0x7f82000aed50 2023-06-09T04:38:14.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f82057d1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820006e690 con 0x7f820006e990 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f81fe7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82000aed50 0x7f8200069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f81fe7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82000aed50 0x7f8200069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37730/0 (socket says 172.21.15.26:37730) 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f81fe7fc700 1 -- 172.21.15.26:0/3148507486 learned_addr learned my addr 172.21.15.26:0/3148507486 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.816+0000 7f81ff7fe700 1 --2- 172.21.15.26:0/3148507486 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f820006e990 0x7f820006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fe7fc700 1 -- 172.21.15.26:0/3148507486 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f820006e990 msgr2=0x7f820006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fe7fc700 1 --2- 172.21.15.26:0/3148507486 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f820006e990 0x7f820006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fe7fc700 1 -- 172.21.15.26:0/3148507486 >> v1:172.21.15.104:6789/0 conn(0x7f820015c6e0 legacy=0x7f82000ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fe7fc700 1 -- 172.21.15.26:0/3148507486 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200160300 con 0x7f82000aed50 2023-06-09T04:38:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fe7fc700 1 --2- 172.21.15.26:0/3148507486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82000aed50 0x7f8200069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81f00098f0 tx=0x7f81f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8edd604494433f63 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fdffb700 1 -- 172.21.15.26:0/3148507486 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f000b8a0 con 0x7f82000aed50 2023-06-09T04:38:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fdffb700 1 -- 172.21.15.26:0/3148507486 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f000ba00 con 0x7f82000aed50 2023-06-09T04:38:14.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f81fdffb700 1 -- 172.21.15.26:0/3148507486 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f000bd90 con 0x7f82000aed50 2023-06-09T04:38:14.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f82057d1700 1 -- 172.21.15.26:0/3148507486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82000aed50 msgr2=0x7f8200069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.817+0000 7f82057d1700 1 --2- 172.21.15.26:0/3148507486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82000aed50 0x7f8200069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81f00098f0 tx=0x7f81f0009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:14.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.818+0000 7f82057d1700 1 -- 172.21.15.26:0/3148507486 shutdown_connections 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.818+0000 7f82057d1700 1 --2- 172.21.15.26:0/3148507486 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f820006e990 0x7f820006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.818+0000 7f82057d1700 1 --2- 172.21.15.26:0/3148507486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82000aed50 0x7f8200069db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.818+0000 7f82057d1700 1 -- 172.21.15.26:0/3148507486 >> 172.21.15.26:0/3148507486 conn(0x7f8200098a30 msgr2=0x7f82000cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.818+0000 7f82057d1700 1 -- 172.21.15.26:0/3148507486 shutdown_connections 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.818+0000 7f82057d1700 1 -- 172.21.15.26:0/3148507486 wait complete. 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.819+0000 7f82057d1700 1 Processor -- start 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.819+0000 7f82057d1700 1 -- start start 2023-06-09T04:38:14.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 0x7f820014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f82000aed50 0x7f82000af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f820015c6e0 0x7f82000cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000ae790 con 0x7f820006e990 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000c3470 con 0x7f820015c6e0 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000c3750 con 0x7f82000aed50 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 0x7f820014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 0x7f820014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37734/0 (socket says 172.21.15.26:37734) 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 -- 172.21.15.26:0/1796264519 learned_addr learned my addr 172.21.15.26:0/1796264519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 -- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f82000aed50 msgr2=0x7f82000af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81ff7fe700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f820015c6e0 0x7f82000cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81fe7fc700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f82000aed50 0x7f82000af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f82000aed50 0x7f82000af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 -- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f820015c6e0 msgr2=0x7f82000cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f820015c6e0 0x7f82000cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 -- 172.21.15.26:0/1796264519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0009550 con 0x7f820006e990 2023-06-09T04:38:14.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81feffd700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 0x7f820014f810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c4d0 tx=0x7f81f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40052d0 con 0x7f820006e990 2023-06-09T04:38:14.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4005430 con 0x7f820006e990 2023-06-09T04:38:14.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40038f0 con 0x7f820006e990 2023-06-09T04:38:14.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.820+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82000c3a30 con 0x7f820006e990 2023-06-09T04:38:14.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.821+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82000af6b0 con 0x7f820006e990 2023-06-09T04:38:14.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.821+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82000d0780 con 0x7f820006e990 2023-06-09T04:38:14.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.822+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81f4003a50 con 0x7f820006e990 2023-06-09T04:38:14.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.822+0000 7f81e77fe700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f81ec06ace0 0x7f81ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.822+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81f4088960 con 0x7f820006e990 2023-06-09T04:38:14.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.822+0000 7f81fe7fc700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f81ec06ace0 0x7f81ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.823+0000 7f81fe7fc700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f81ec06ace0 0x7f81ec06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82000af140 tx=0x7f81f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:14.827+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f81f4053aa0 con 0x7f820006e990 2023-06-09T04:38:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.020+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82001608c0 con 0x7f81ec06ace0 2023-06-09T04:38:15.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.029+0000 7f81e77fe700 1 -- 172.21.15.26:0/1796264519 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279415 (secure 0 0 0) 0x7f81f001f070 con 0x7f81ec06ace0 2023-06-09T04:38:15.033 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f81ec06ace0 msgr2=0x7f81ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f81ec06ace0 0x7f81ec06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82000af140 tx=0x7f81f0008030 comp rx=0 tx=0).stop 2023-06-09T04:38:15.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 msgr2=0x7f820014f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 0x7f820014f810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c4d0 tx=0x7f81f400c890 comp rx=0 tx=0).stop 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 shutdown_connections 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f820015c6e0 0x7f82000cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f81ec06ace0 0x7f81ec06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820006e990 0x7f820014f810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 --2- 172.21.15.26:0/1796264519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f82000aed50 0x7f82000af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 >> 172.21.15.26:0/1796264519 conn(0x7f8200098a30 msgr2=0x7f82000cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 shutdown_connections 2023-06-09T04:38:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.032+0000 7f82057d1700 1 -- 172.21.15.26:0/1796264519 wait complete. 2023-06-09T04:38:15.036 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-06-09T04:38:13.873679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218472,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756248,"statfs":{"total":773094113280,"available":772870397952,"internally_reserved":0,"allocated":2670592,"data_stored":1683328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.392499"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.459967+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:06.459967+0000","last_peered":"2023-06-09T04:38:06.459967+0000","last_clean":"2023-06-09T04:38:06.459967+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:06.459967+0000","last_undegraded":"2023-06-09T04:38:06.459967+0000","last_fullsized":"2023-06-09T04:38:06.459967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:48.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922981+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:12.922981+0000","last_peered":"2023-06-09T04:38:12.922981+0000","last_clean":"2023-06-09T04:38:12.922981+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:12.922981+0000","last_undegraded":"2023-06-09T04:38:12.922981+0000","last_fullsized":"2023-06-09T04:38:12.922981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.548636+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:06.548636+0000","last_peered":"2023-06-09T04:38:06.548636+0000","last_clean":"2023-06-09T04:38:06.548636+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:06.548636+0000","last_undegraded":"2023-06-09T04:38:06.548636+0000","last_fullsized":"2023-06-09T04:38:06.548636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:35:39.578451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.396316+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:06.396316+0000","last_peered":"2023-06-09T04:38:06.396316+0000","last_clean":"2023-06-09T04:38:06.396316+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:06.396316+0000","last_undegraded":"2023-06-09T04:38:06.396316+0000","last_fullsized":"2023-06-09T04:38:06.396316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:38:31.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.396335+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:06.396335+0000","last_peered":"2023-06-09T04:38:06.396335+0000","last_clean":"2023-06-09T04:38:06.396335+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:06.396335+0000","last_undegraded":"2023-06-09T04:38:06.396335+0000","last_fullsized":"2023-06-09T04:38:06.396335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:04.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.747852+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:06.747852+0000","last_peered":"2023-06-09T04:38:06.747852+0000","last_clean":"2023-06-09T04:38:06.747852+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:06.747852+0000","last_undegraded":"2023-06-09T04:38:06.747852+0000","last_fullsized":"2023-06-09T04:38:06.747852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:48.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.748019+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:06.748019+0000","last_peered":"2023-06-09T04:38:06.748019+0000","last_clean":"2023-06-09T04:38:06.748019+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:06.748019+0000","last_undegraded":"2023-06-09T04:38:06.748019+0000","last_fullsized":"2023-06-09T04:38:06.748019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:04.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.747990+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:06.747990+0000","last_peered":"2023-06-09T04:38:06.747990+0000","last_clean":"2023-06-09T04:38:06.747990+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:06.747990+0000","last_undegraded":"2023-06-09T04:38:06.747990+0000","last_fullsized":"2023-06-09T04:38:06.747990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:38:31.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":757760,"data_stored":641776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":70747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":70165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:15.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:15.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.208+0000 7fd54f869700 1 Processor -- start 2023-06-09T04:38:15.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.208+0000 7fd54f869700 1 -- start start 2023-06-09T04:38:15.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.208+0000 7fd54f869700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd54815c6e0 0x7fd5480ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54f869700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd548098e30 0x7fd5480aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54f869700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54806f190 con 0x7fd54806e990 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54f869700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54806e440 con 0x7fd54815c6e0 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54f869700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54806e690 con 0x7fd548098e30 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd54815c6e0 0x7fd5480ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd54815c6e0 0x7fd5480ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37742/0 (socket says 172.21.15.26:37742) 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 -- 172.21.15.26:0/1736921272 learned_addr learned my addr 172.21.15.26:0/1736921272 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:15.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54de06700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd548098e30 0x7fd5480aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 -- 172.21.15.26:0/1736921272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd548098e30 msgr2=0x7fd5480aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd548098e30 0x7fd5480aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 -- 172.21.15.26:0/1736921272 >> v1:172.21.15.104:6789/0 conn(0x7fd54806e990 legacy=0x7fd5480cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 -- 172.21.15.26:0/1736921272 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548160300 con 0x7fd54815c6e0 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54de06700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd548098e30 0x7fd5480aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd54d605700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd54815c6e0 0x7fd5480ae640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd544006fd0 tx=0x7fd544009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e63b8d0508b2a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd53bfff700 1 -- 172.21.15.26:0/1736921272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544005e30 con 0x7fd54815c6e0 2023-06-09T04:38:15.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd53bfff700 1 -- 172.21.15.26:0/1736921272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544004030 con 0x7fd54815c6e0 2023-06-09T04:38:15.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.209+0000 7fd53bfff700 1 -- 172.21.15.26:0/1736921272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440043e0 con 0x7fd54815c6e0 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 -- 172.21.15.26:0/1736921272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd54815c6e0 msgr2=0x7fd5480ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd54815c6e0 0x7fd5480ae640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd544006fd0 tx=0x7fd544009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 -- 172.21.15.26:0/1736921272 shutdown_connections 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd548098e30 0x7fd5480aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 --2- 172.21.15.26:0/1736921272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd54815c6e0 0x7fd5480ae640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 -- 172.21.15.26:0/1736921272 >> 172.21.15.26:0/1736921272 conn(0x7fd548098a30 msgr2=0x7fd5480cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 -- 172.21.15.26:0/1736921272 shutdown_connections 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.210+0000 7fd54f869700 1 -- 172.21.15.26:0/1736921272 wait complete. 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.211+0000 7fd54f869700 1 Processor -- start 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.211+0000 7fd54f869700 1 -- start start 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54f869700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd54806e990 0x7fd5480b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54f869700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 0x7fd5481f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54f869700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd54815c6e0 0x7fd5481f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54f869700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480c9760 con 0x7fd548098e30 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54f869700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b2140 con 0x7fd54806e990 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54f869700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480c68b0 con 0x7fd54815c6e0 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 0x7fd5481f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 0x7fd5481f5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37750/0 (socket says 172.21.15.26:37750) 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 -- 172.21.15.26:0/2196633349 learned_addr learned my addr 172.21.15.26:0/2196633349 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54d605700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd54806e990 0x7fd5480b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54de06700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd54815c6e0 0x7fd5481f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 -- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd54815c6e0 msgr2=0x7fd5481f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd54815c6e0 0x7fd5481f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 -- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd54806e990 msgr2=0x7fd5480b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd54806e990 0x7fd5480b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.212+0000 7fd54ce04700 1 -- 172.21.15.26:0/2196633349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009500 con 0x7fd548098e30 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd54d605700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd54806e990 0x7fd5480b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd54ce04700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 0x7fd5481f5420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c4b0 tx=0x7fd53c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0052d0 con 0x7fd548098e30 2023-06-09T04:38:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c005430 con 0x7fd548098e30 2023-06-09T04:38:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5480b3ec0 con 0x7fd548098e30 2023-06-09T04:38:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0038c0 con 0x7fd548098e30 2023-06-09T04:38:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.213+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5480c9480 con 0x7fd548098e30 2023-06-09T04:38:15.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.214+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5480b0b40 con 0x7fd548098e30 2023-06-09T04:38:15.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.214+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd53c003a20 con 0x7fd548098e30 2023-06-09T04:38:15.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.215+0000 7fd539ffb700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd52c06ace0 0x7fd52c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.215+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd53c088910 con 0x7fd548098e30 2023-06-09T04:38:15.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.215+0000 7fd54d605700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd52c06ace0 0x7fd52c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.215+0000 7fd54d605700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd52c06ace0 0x7fd52c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd544009c10 tx=0x7fd544008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.219+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd53c0539e0 con 0x7fd548098e30 2023-06-09T04:38:15.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.414+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5481608c0 con 0x7fd52c06ace0 2023-06-09T04:38:15.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.421+0000 7fd539ffb700 1 -- 172.21.15.26:0/2196633349 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279415 (secure 0 0 0) 0x7fd5440042c0 con 0x7fd52c06ace0 2023-06-09T04:38:15.425 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:15.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd52c06ace0 msgr2=0x7fd52c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd52c06ace0 0x7fd52c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd544009c10 tx=0x7fd544008070 comp rx=0 tx=0).stop 2023-06-09T04:38:15.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 msgr2=0x7fd5481f5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 0x7fd5481f5420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c4b0 tx=0x7fd53c00c870 comp rx=0 tx=0).stop 2023-06-09T04:38:15.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 shutdown_connections 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd54815c6e0 0x7fd5481f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd54806e990 0x7fd5480b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd52c06ace0 0x7fd52c06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 --2- 172.21.15.26:0/2196633349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd548098e30 0x7fd5481f5420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 >> 172.21.15.26:0/2196633349 conn(0x7fd548098a30 msgr2=0x7fd5480ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 shutdown_connections 2023-06-09T04:38:15.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.425+0000 7fd54f869700 1 -- 172.21.15.26:0/2196633349 wait complete. 2023-06-09T04:38:15.429 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:15.438 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-06-09T04:38:13.873679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218472,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756248,"statfs":{"total":773094113280,"available":772870397952,"internally_reserved":0,"allocated":2670592,"data_stored":1683328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.392499"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.459967+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:06.459967+0000","last_peered":"2023-06-09T04:38:06.459967+0000","last_clean":"2023-06-09T04:38:06.459967+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:06.459967+0000","last_undegraded":"2023-06-09T04:38:06.459967+0000","last_fullsized":"2023-06-09T04:38:06.459967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:48.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922981+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:12.922981+0000","last_peered":"2023-06-09T04:38:12.922981+0000","last_clean":"2023-06-09T04:38:12.922981+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:12.922981+0000","last_undegraded":"2023-06-09T04:38:12.922981+0000","last_fullsized":"2023-06-09T04:38:12.922981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.548636+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:06.548636+0000","last_peered":"2023-06-09T04:38:06.548636+0000","last_clean":"2023-06-09T04:38:06.548636+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:06.548636+0000","last_undegraded":"2023-06-09T04:38:06.548636+0000","last_fullsized":"2023-06-09T04:38:06.548636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:35:39.578451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.396316+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:06.396316+0000","last_peered":"2023-06-09T04:38:06.396316+0000","last_clean":"2023-06-09T04:38:06.396316+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:06.396316+0000","last_undegraded":"2023-06-09T04:38:06.396316+0000","last_fullsized":"2023-06-09T04:38:06.396316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:38:31.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.396335+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:06.396335+0000","last_peered":"2023-06-09T04:38:06.396335+0000","last_clean":"2023-06-09T04:38:06.396335+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:06.396335+0000","last_undegraded":"2023-06-09T04:38:06.396335+0000","last_fullsized":"2023-06-09T04:38:06.396335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:04.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.747852+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:06.747852+0000","last_peered":"2023-06-09T04:38:06.747852+0000","last_clean":"2023-06-09T04:38:06.747852+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:06.747852+0000","last_undegraded":"2023-06-09T04:38:06.747852+0000","last_fullsized":"2023-06-09T04:38:06.747852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:48.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.748019+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:06.748019+0000","last_peered":"2023-06-09T04:38:06.748019+0000","last_clean":"2023-06-09T04:38:06.748019+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:06.748019+0000","last_undegraded":"2023-06-09T04:38:06.748019+0000","last_fullsized":"2023-06-09T04:38:06.748019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:04.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.747990+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:06.747990+0000","last_peered":"2023-06-09T04:38:06.747990+0000","last_clean":"2023-06-09T04:38:06.747990+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:06.747990+0000","last_undegraded":"2023-06-09T04:38:06.747990+0000","last_fullsized":"2023-06-09T04:38:06.747990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:38:31.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":757760,"data_stored":641776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":70747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":70165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:15.445 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.601+0000 7efe82480700 1 Processor -- start 2023-06-09T04:38:15.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.602+0000 7efe82480700 1 -- start start 2023-06-09T04:38:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe82480700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c143990 0x7efe7c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe82480700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe7c06b280 0x7efe7c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe82480700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c0ce600 con 0x7efe7c070ab0 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe82480700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c0cfe50 con 0x7efe7c06b280 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe82480700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0cd200 con 0x7efe7c143990 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe7c06b280 0x7efe7c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe7c06b280 0x7efe7c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37758/0 (socket says 172.21.15.26:37758) 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 -- 172.21.15.26:0/980324893 learned_addr learned my addr 172.21.15.26:0/980324893 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:15.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7bfff700 1 --2- 172.21.15.26:0/980324893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c143990 0x7efe7c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 -- 172.21.15.26:0/980324893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c143990 msgr2=0x7efe7c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 --2- 172.21.15.26:0/980324893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c143990 0x7efe7c0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 -- 172.21.15.26:0/980324893 >> v1:172.21.15.104:6789/0 conn(0x7efe7c070ab0 legacy=0x7efe7c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 -- 172.21.15.26:0/980324893 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0cb7c0 con 0x7efe7c06b280 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.603+0000 7efe7b7fe700 1 --2- 172.21.15.26:0/980324893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c0cccc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe70009920 tx=0x7efe70009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25e0fc63146abfa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe7affd700 1 -- 172.21.15.26:0/980324893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000ba20 con 0x7efe7c06b280 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe7affd700 1 -- 172.21.15.26:0/980324893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000bb80 con 0x7efe7c06b280 2023-06-09T04:38:15.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe7affd700 1 -- 172.21.15.26:0/980324893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70009e70 con 0x7efe7c06b280 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 -- 172.21.15.26:0/980324893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 msgr2=0x7efe7c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 --2- 172.21.15.26:0/980324893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c0cccc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe70009920 tx=0x7efe70009c30 comp rx=0 tx=0).stop 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 -- 172.21.15.26:0/980324893 shutdown_connections 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 --2- 172.21.15.26:0/980324893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c143990 0x7efe7c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 --2- 172.21.15.26:0/980324893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c0cccc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 -- 172.21.15.26:0/980324893 >> 172.21.15.26:0/980324893 conn(0x7efe7c0b17e0 msgr2=0x7efe7c0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 -- 172.21.15.26:0/980324893 shutdown_connections 2023-06-09T04:38:15.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.604+0000 7efe82480700 1 -- 172.21.15.26:0/980324893 wait complete. 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.605+0000 7efe82480700 1 Processor -- start 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 -- start start 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c070ab0 0x7efe7c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe7c143990 0x7efe7c1f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c1598e0 con 0x7efe7c06b280 2023-06-09T04:38:15.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c1f62d0 con 0x7efe7c143990 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.606+0000 7efe82480700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c1f5d10 con 0x7efe7c070ab0 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37762/0 (socket says 172.21.15.26:37762) 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 -- 172.21.15.26:0/685944782 learned_addr learned my addr 172.21.15.26:0/685944782 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe80a1d700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe7c143990 0x7efe7c1f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 -- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c070ab0 msgr2=0x7efe7c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c070ab0 0x7efe7c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 -- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe7c143990 msgr2=0x7efe7c1f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe7c143990 0x7efe7c1f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 -- 172.21.15.26:0/685944782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70009550 con 0x7efe7c06b280 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe80a1d700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe7c143990 0x7efe7c1f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe7bfff700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c1593a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00e810 tx=0x7efe6c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c013610 con 0x7efe7c06b280 2023-06-09T04:38:15.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c013770 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c1f5ff0 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c013b20 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.607+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c15ad60 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.608+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c067180 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.609+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe6c013c80 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.609+0000 7efe78ff9700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efe6806ace0 0x7efe6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.609+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe6c089200 con 0x7efe7c06b280 2023-06-09T04:38:15.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.609+0000 7efe7b7fe700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efe6806ace0 0x7efe6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.610+0000 7efe7b7fe700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efe6806ace0 0x7efe6806d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe70014040 tx=0x7efe70010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.613+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe6c057d40 con 0x7efe7c06b280 2023-06-09T04:38:15.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.809+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe7c15e690 con 0x7efe6806ace0 2023-06-09T04:38:15.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.817+0000 7efe78ff9700 1 -- 172.21.15.26:0/685944782 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279415 (secure 0 0 0) 0x7efe7001e070 con 0x7efe6806ace0 2023-06-09T04:38:15.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:15.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efe6806ace0 msgr2=0x7efe6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efe6806ace0 0x7efe6806d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe70014040 tx=0x7efe70010000 comp rx=0 tx=0).stop 2023-06-09T04:38:15.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 msgr2=0x7efe7c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c1593a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00e810 tx=0x7efe6c00ebd0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 shutdown_connections 2023-06-09T04:38:15.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe7c143990 0x7efe7c1f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efe6806ace0 0x7efe6806d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe7c06b280 0x7efe7c1593a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 --2- 172.21.15.26:0/685944782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efe7c070ab0 0x7efe7c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 >> 172.21.15.26:0/685944782 conn(0x7efe7c0b17e0 msgr2=0x7efe7c0aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 shutdown_connections 2023-06-09T04:38:15.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.820+0000 7efe82480700 1 -- 172.21.15.26:0/685944782 wait complete. 2023-06-09T04:38:15.824 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:15.834 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-06-09T04:38:13.873679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218472,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756248,"statfs":{"total":773094113280,"available":772870397952,"internally_reserved":0,"allocated":2670592,"data_stored":1683328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.392499"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.459967+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:06.459967+0000","last_peered":"2023-06-09T04:38:06.459967+0000","last_clean":"2023-06-09T04:38:06.459967+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:06.459967+0000","last_undegraded":"2023-06-09T04:38:06.459967+0000","last_fullsized":"2023-06-09T04:38:06.459967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:48.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922981+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:12.922981+0000","last_peered":"2023-06-09T04:38:12.922981+0000","last_clean":"2023-06-09T04:38:12.922981+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:12.922981+0000","last_undegraded":"2023-06-09T04:38:12.922981+0000","last_fullsized":"2023-06-09T04:38:12.922981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.548636+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:06.548636+0000","last_peered":"2023-06-09T04:38:06.548636+0000","last_clean":"2023-06-09T04:38:06.548636+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:06.548636+0000","last_undegraded":"2023-06-09T04:38:06.548636+0000","last_fullsized":"2023-06-09T04:38:06.548636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:35:39.578451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.396316+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:06.396316+0000","last_peered":"2023-06-09T04:38:06.396316+0000","last_clean":"2023-06-09T04:38:06.396316+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:06.396316+0000","last_undegraded":"2023-06-09T04:38:06.396316+0000","last_fullsized":"2023-06-09T04:38:06.396316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:38:31.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.396335+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:06.396335+0000","last_peered":"2023-06-09T04:38:06.396335+0000","last_clean":"2023-06-09T04:38:06.396335+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:06.396335+0000","last_undegraded":"2023-06-09T04:38:06.396335+0000","last_fullsized":"2023-06-09T04:38:06.396335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:04.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.747852+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:06.747852+0000","last_peered":"2023-06-09T04:38:06.747852+0000","last_clean":"2023-06-09T04:38:06.747852+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:06.747852+0000","last_undegraded":"2023-06-09T04:38:06.747852+0000","last_fullsized":"2023-06-09T04:38:06.747852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:48.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.748019+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:06.748019+0000","last_peered":"2023-06-09T04:38:06.748019+0000","last_clean":"2023-06-09T04:38:06.748019+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:06.748019+0000","last_undegraded":"2023-06-09T04:38:06.748019+0000","last_fullsized":"2023-06-09T04:38:06.748019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:04.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-06-09T04:38:06.747990+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:06.747990+0000","last_peered":"2023-06-09T04:38:06.747990+0000","last_clean":"2023-06-09T04:38:06.747990+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:06.747990+0000","last_undegraded":"2023-06-09T04:38:06.747990+0000","last_fullsized":"2023-06-09T04:38:06.747990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:38:31.009757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:09.471237+0000","last_change":"2023-06-09T04:38:09.471237+0000","last_active":"2023-06-09T04:38:09.471237+0000","last_peered":"2023-06-09T04:38:09.471237+0000","last_clean":"2023-06-09T04:38:09.471237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:09.471237+0000","last_undegraded":"2023-06-09T04:38:09.471237+0000","last_fullsized":"2023-06-09T04:38:09.471237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:10.476433+0000","last_change":"2023-06-09T04:38:10.476433+0000","last_active":"2023-06-09T04:38:10.476433+0000","last_peered":"2023-06-09T04:38:10.476433+0000","last_clean":"2023-06-09T04:38:10.476433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:10.476433+0000","last_undegraded":"2023-06-09T04:38:10.476433+0000","last_fullsized":"2023-06-09T04:38:10.476433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":757760,"data_stored":641776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":70747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":70165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":51408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:15.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-06-09T04:38:15.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-06-09T04:38:15.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-06-09T04:38:15.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-06-09T04:38:15.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-06-09T04:38:15.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-06-09T04:38:15.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-06-09T04:38:15.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-06-09T04:38:15.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-06-09T04:38:15.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-06-09T04:38:15.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-06-09T04:38:15.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-06-09T04:38:15.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-06-09T04:38:15.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-06-09T04:38:15.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-06-09T04:38:15.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-06-09T04:38:15.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-06-09T04:38:15.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-06-09T04:38:15.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-06-09T04:38:15.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-06-09T04:38:15.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-06-09T04:38:15.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-06-09T04:38:15.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-06-09T04:38:15.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-06-09T04:38:15.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-06-09T04:38:15.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-06-09T04:38:15.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-06-09T04:38:15.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-06-09T04:38:15.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-06-09T04:38:15.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-06-09T04:38:15.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-06-09T04:38:15.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-06-09T04:38:15.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-06-09T04:38:15.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-06-09T04:38:15.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-06-09T04:38:15.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-06-09T04:38:15.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-06-09T04:38:15.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-06-09T04:38:15.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-06-09T04:38:15.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-06-09T04:38:15.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-06-09T04:38:15.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-06-09T04:38:15.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-06-09T04:38:15.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-06-09T04:38:15.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-06-09T04:38:15.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:09.471237+0000', 'last_change': '2023-06-09T04:38:09.471237+0000', 'last_active': '2023-06-09T04:38:09.471237+0000', 'last_peered': '2023-06-09T04:38:09.471237+0000', 'last_clean': '2023-06-09T04:38:09.471237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:09.471237+0000', 'last_undegraded': '2023-06-09T04:38:09.471237+0000', 'last_fullsized': '2023-06-09T04:38:09.471237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:09.471237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-06-09T04:38:15.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-06-09T04:38:15.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-06-09T04:38:15.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-06-09T04:38:15.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:38:10.476433+0000', 'last_change': '2023-06-09T04:38:10.476433+0000', 'last_active': '2023-06-09T04:38:10.476433+0000', 'last_peered': '2023-06-09T04:38:10.476433+0000', 'last_clean': '2023-06-09T04:38:10.476433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:38:10.476433+0000', 'last_undegraded': '2023-06-09T04:38:10.476433+0000', 'last_fullsized': '2023-06-09T04:38:10.476433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'last_clean_scrub_stamp': '2023-06-09T04:38:10.476433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:38:15.867 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-09T04:38:15.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.996+0000 7fd01b290700 1 Processor -- start 2023-06-09T04:38:15.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.996+0000 7fd01b290700 1 -- start start 2023-06-09T04:38:16.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01b290700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd01415c550 0x7fd014160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01b290700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd0140cc620 0x7fd0140caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01b290700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0140cce70 con 0x7fd0140d0740 2023-06-09T04:38:16.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01b290700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd014161030 con 0x7fd01415c550 2023-06-09T04:38:16.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01b290700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd014160790 con 0x7fd0140cc620 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01902c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd01415c550 0x7fd014160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01982d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd0140d0740 0x7fd0140d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46632/0 (socket says 172.21.15.26:46632) 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.997+0000 7fd01982d700 1 -- 172.21.15.26:0/2473772179 learned_addr learned my addr 172.21.15.26:0/2473772179 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01882b700 1 --2- 172.21.15.26:0/2473772179 >> v2:172.21.15.104:3300/0 conn(0x7fd0140cc620 0x7fd0140caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01902c700 1 -- 172.21.15.26:0/2473772179 >> v2:172.21.15.104:3300/0 conn(0x7fd0140cc620 msgr2=0x7fd0140caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01902c700 1 --2- 172.21.15.26:0/2473772179 >> v2:172.21.15.104:3300/0 conn(0x7fd0140cc620 0x7fd0140caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01902c700 1 -- 172.21.15.26:0/2473772179 >> v1:172.21.15.26:6789/0 conn(0x7fd0140d0740 legacy=0x7fd0140d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01902c700 1 -- 172.21.15.26:0/2473772179 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014160a70 con 0x7fd01415c550 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01882b700 1 --2- 172.21.15.26:0/2473772179 >> v2:172.21.15.104:3300/0 conn(0x7fd0140cc620 0x7fd0140caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01902c700 1 --2- 172.21.15.26:0/2473772179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd01415c550 0x7fd014160100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0140b0760 tx=0x7fd004009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539803d973eac5b7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd00bfff700 1 -- 172.21.15.26:0/2473772179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004005e30 con 0x7fd01415c550 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd00bfff700 1 -- 172.21.15.26:0/2473772179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004006030 con 0x7fd01415c550 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd00bfff700 1 -- 172.21.15.26:0/2473772179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040063c0 con 0x7fd01415c550 2023-06-09T04:38:16.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01b290700 1 -- 172.21.15.26:0/2473772179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd01415c550 msgr2=0x7fd014160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01b290700 1 --2- 172.21.15.26:0/2473772179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd01415c550 0x7fd014160100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0140b0760 tx=0x7fd004009b00 comp rx=0 tx=0).stop 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01b290700 1 -- 172.21.15.26:0/2473772179 shutdown_connections 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01b290700 1 --2- 172.21.15.26:0/2473772179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd01415c550 0x7fd014160100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01b290700 1 --2- 172.21.15.26:0/2473772179 >> v2:172.21.15.104:3300/0 conn(0x7fd0140cc620 0x7fd0140caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.998+0000 7fd01b290700 1 -- 172.21.15.26:0/2473772179 >> 172.21.15.26:0/2473772179 conn(0x7fd014089fc0 msgr2=0x7fd01408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.999+0000 7fd01b290700 1 -- 172.21.15.26:0/2473772179 shutdown_connections 2023-06-09T04:38:16.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:15.999+0000 7fd01b290700 1 -- 172.21.15.26:0/2473772179 wait complete. 2023-06-09T04:38:16.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.000+0000 7fd01b290700 1 Processor -- start 2023-06-09T04:38:16.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.000+0000 7fd01b290700 1 -- start start 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0140cc620 0x7fd0141ef530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 0x7fd014158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd01415c550 0x7fd0141593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140b6510 con 0x7fd0140d0740 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140b5f50 con 0x7fd01415c550 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140b6230 con 0x7fd0140cc620 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 0x7fd014158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 0x7fd014158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37778/0 (socket says 172.21.15.26:37778) 2023-06-09T04:38:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 -- 172.21.15.26:0/2755523348 learned_addr learned my addr 172.21.15.26:0/2755523348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01982d700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd01415c550 0x7fd0141593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 -- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0140cc620 msgr2=0x7fd0141ef530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0140cc620 0x7fd0141ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 -- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd01415c550 msgr2=0x7fd0141593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd01415c550 0x7fd0141593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 -- 172.21.15.26:0/2755523348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009430 con 0x7fd0140d0740 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01882b700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 0x7fd014158e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c7f0 tx=0x7fd01000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010004220 con 0x7fd0140d0740 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100043a0 con 0x7fd0140d0740 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0140ad510 con 0x7fd0140d0740 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100038e0 con 0x7fd0140d0740 2023-06-09T04:38:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.001+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0141efa70 con 0x7fd0140d0740 2023-06-09T04:38:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.002+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0140b1db0 con 0x7fd0140d0740 2023-06-09T04:38:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.003+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd010003a40 con 0x7fd0140d0740 2023-06-09T04:38:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.003+0000 7fd009ffb700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcff806ace0 0x7fcff806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.003+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd010089050 con 0x7fd0140d0740 2023-06-09T04:38:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.003+0000 7fd01902c700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcff806ace0 0x7fcff806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.004+0000 7fd01902c700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcff806ace0 0x7fcff806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd004013040 tx=0x7fd004010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.008+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd010057b90 con 0x7fd0140d0740 2023-06-09T04:38:16.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.286+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd0140d14e0 con 0x7fd0140d0740 2023-06-09T04:38:16.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.287+0000 7fd009ffb700 1 -- 172.21.15.26:0/2755523348 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fd010057720 con 0x7fd0140d0740 2023-06-09T04:38:16.288 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:16.289 INFO:teuthology.orchestra.run.smithi026.stdout:{"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1686285483,"num_in_osds":8,"osd_in_since":1686285474,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":223715328,"bytes_avail":772870397952,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4300}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-06-09T04:37:52.280108+0000","services":{}},"progress_events":{}} 2023-06-09T04:38:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcff806ace0 msgr2=0x7fcff806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcff806ace0 0x7fcff806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd004013040 tx=0x7fd004010000 comp rx=0 tx=0).stop 2023-06-09T04:38:16.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 msgr2=0x7fd014158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 0x7fd014158e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c7f0 tx=0x7fd01000cbb0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 shutdown_connections 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd01415c550 0x7fd0141593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0140cc620 0x7fd0141ef530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcff806ace0 0x7fcff806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 --2- 172.21.15.26:0/2755523348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0140d0740 0x7fd014158e80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 >> 172.21.15.26:0/2755523348 conn(0x7fd014089fc0 msgr2=0x7fd01406fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 shutdown_connections 2023-06-09T04:38:16.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.289+0000 7fd01b290700 1 -- 172.21.15.26:0/2755523348 wait complete. 2023-06-09T04:38:16.302 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-09T04:38:16.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.425+0000 7f4356e6a700 1 Processor -- start 2023-06-09T04:38:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.425+0000 7f4356e6a700 1 -- start start 2023-06-09T04:38:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4356e6a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43500cc620 0x7f4350160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4356e6a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f43500d0740 0x7f43500d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4356e6a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43500cce70 con 0x7f435015c550 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4356e6a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350161030 con 0x7f43500cc620 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4356e6a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350160790 con 0x7f43500d0740 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f434ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43500cc620 0x7f4350160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4354c06700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f435015c550 0x7f43500caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46642/0 (socket says 172.21.15.26:46642) 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4354c06700 1 -- 172.21.15.26:0/1279739241 learned_addr learned my addr 172.21.15.26:0/1279739241 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:16.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f4355407700 1 --2- 172.21.15.26:0/1279739241 >> v2:172.21.15.104:3300/0 conn(0x7f43500d0740 0x7f43500d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f434ffff700 1 -- 172.21.15.26:0/1279739241 >> v2:172.21.15.104:3300/0 conn(0x7f43500d0740 msgr2=0x7f43500d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f434ffff700 1 --2- 172.21.15.26:0/1279739241 >> v2:172.21.15.104:3300/0 conn(0x7f43500d0740 0x7f43500d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f434ffff700 1 -- 172.21.15.26:0/1279739241 >> v1:172.21.15.26:6789/0 conn(0x7f435015c550 legacy=0x7f43500caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f434ffff700 1 -- 172.21.15.26:0/1279739241 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350160a70 con 0x7f43500cc620 2023-06-09T04:38:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.426+0000 7f434ffff700 1 --2- 172.21.15.26:0/1279739241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f4350160100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f435008acd0 tx=0x7f433c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3869e9ce81747c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f434f7fe700 1 -- 172.21.15.26:0/1279739241 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c011830 con 0x7f43500cc620 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f434f7fe700 1 -- 172.21.15.26:0/1279739241 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c011990 con 0x7f43500cc620 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f434f7fe700 1 -- 172.21.15.26:0/1279739241 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c011d20 con 0x7f43500cc620 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 -- 172.21.15.26:0/1279739241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 msgr2=0x7f4350160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 --2- 172.21.15.26:0/1279739241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f4350160100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f435008acd0 tx=0x7f433c009b20 comp rx=0 tx=0).stop 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 -- 172.21.15.26:0/1279739241 shutdown_connections 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 --2- 172.21.15.26:0/1279739241 >> v2:172.21.15.104:3300/0 conn(0x7f43500d0740 0x7f43500d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 --2- 172.21.15.26:0/1279739241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f4350160100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 -- 172.21.15.26:0/1279739241 >> 172.21.15.26:0/1279739241 conn(0x7f4350089fc0 msgr2=0x7f435008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 -- 172.21.15.26:0/1279739241 shutdown_connections 2023-06-09T04:38:16.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.427+0000 7f4356e6a700 1 -- 172.21.15.26:0/1279739241 wait complete. 2023-06-09T04:38:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.428+0000 7f4356e6a700 1 Processor -- start 2023-06-09T04:38:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 -- start start 2023-06-09T04:38:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f43500b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43500d0740 0x7f43500cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f435015c550 0x7f4350152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500ad470 con 0x7f43500cc620 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500b3da0 con 0x7f43500d0740 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4356e6a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500b4080 con 0x7f435015c550 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.429+0000 7f4354c06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f43500b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f43500b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37790/0 (socket says 172.21.15.26:37790) 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 -- 172.21.15.26:0/2024986396 learned_addr learned my addr 172.21.15.26:0/2024986396 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f434ffff700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43500d0740 0x7f43500cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4355407700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f435015c550 0x7f4350152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 -- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f435015c550 msgr2=0x7f4350152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f435015c550 0x7f4350152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 -- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43500d0740 msgr2=0x7f43500cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43500d0740 0x7f43500cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 -- 172.21.15.26:0/2024986396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0094a0 con 0x7f43500cc620 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4354c06700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f43500b3710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f434400c4d0 tx=0x7f434400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43440074e0 con 0x7f43500cc620 2023-06-09T04:38:16.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344007640 con 0x7f43500cc620 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500b4360 con 0x7f43500cc620 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344005a30 con 0x7f43500cc620 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.430+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43500b4df0 con 0x7f43500cc620 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.431+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43500b1db0 con 0x7f43500cc620 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.431+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4344005b90 con 0x7f43500cc620 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.432+0000 7f434d7fa700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f433406ace0 0x7f433406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.432+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4344088740 con 0x7f43500cc620 2023-06-09T04:38:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.432+0000 7f434ffff700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f433406ace0 0x7f433406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.432+0000 7f434ffff700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f433406ace0 0x7f433406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f435008acd0 tx=0x7f433c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.436+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4344053930 con 0x7f43500cc620 2023-06-09T04:38:16.539 INFO:tasks.ceph.mds.d.smithi104.stderr:2023-06-09T04:38:16.539+0000 7f8192f98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:38:16.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.631+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43500cd1f0 con 0x7f433406ace0 2023-06-09T04:38:16.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.639+0000 7f434d7fa700 1 -- 172.21.15.26:0/2024986396 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286935 (secure 0 0 0) 0x7f433c011b00 con 0x7f433406ace0 2023-06-09T04:38:16.643 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f433406ace0 msgr2=0x7f433406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f433406ace0 0x7f433406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f435008acd0 tx=0x7f433c008030 comp rx=0 tx=0).stop 2023-06-09T04:38:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 msgr2=0x7f43500b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f43500b3710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f434400c4d0 tx=0x7f434400c890 comp rx=0 tx=0).stop 2023-06-09T04:38:16.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 shutdown_connections 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f435015c550 0x7f4350152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f433406ace0 0x7f433406d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43500cc620 0x7f43500b3710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 --2- 172.21.15.26:0/2024986396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43500d0740 0x7f43500cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 >> 172.21.15.26:0/2024986396 conn(0x7f4350089fc0 msgr2=0x7f43500b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 shutdown_connections 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:16.642+0000 7f4356e6a700 1 -- 172.21.15.26:0/2024986396 wait complete. 2023-06-09T04:38:16.646 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:16.655 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-06-09T04:38:15.874395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218472,"kb_used_data":2856,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756248,"statfs":{"total":773094113280,"available":772870397952,"internally_reserved":0,"allocated":2924544,"data_stored":1793664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001692"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910608+0000","last_change":"2023-06-09T04:38:10.931316+0000","last_active":"2023-06-09T04:38:11.910608+0000","last_peered":"2023-06-09T04:38:11.910608+0000","last_clean":"2023-06-09T04:38:11.910608+0000","last_became_active":"2023-06-09T04:38:10.930993+0000","last_became_peered":"2023-06-09T04:38:10.930993+0000","last_unstale":"2023-06-09T04:38:11.910608+0000","last_undegraded":"2023-06-09T04:38:11.910608+0000","last_fullsized":"2023-06-09T04:38:11.910608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910788+0000","last_change":"2023-06-09T04:38:10.922601+0000","last_active":"2023-06-09T04:38:11.910788+0000","last_peered":"2023-06-09T04:38:11.910788+0000","last_clean":"2023-06-09T04:38:11.910788+0000","last_became_active":"2023-06-09T04:38:10.922025+0000","last_became_peered":"2023-06-09T04:38:10.922025+0000","last_unstale":"2023-06-09T04:38:11.910788+0000","last_undegraded":"2023-06-09T04:38:11.910788+0000","last_fullsized":"2023-06-09T04:38:11.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412633+0000","last_change":"2023-06-09T04:38:10.931451+0000","last_active":"2023-06-09T04:38:13.412633+0000","last_peered":"2023-06-09T04:38:13.412633+0000","last_clean":"2023-06-09T04:38:13.412633+0000","last_became_active":"2023-06-09T04:38:10.931055+0000","last_became_peered":"2023-06-09T04:38:10.931055+0000","last_unstale":"2023-06-09T04:38:13.412633+0000","last_undegraded":"2023-06-09T04:38:13.412633+0000","last_fullsized":"2023-06-09T04:38:13.412633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910850+0000","last_change":"2023-06-09T04:38:10.922227+0000","last_active":"2023-06-09T04:38:11.910850+0000","last_peered":"2023-06-09T04:38:11.910850+0000","last_clean":"2023-06-09T04:38:11.910850+0000","last_became_active":"2023-06-09T04:38:10.921928+0000","last_became_peered":"2023-06-09T04:38:10.921928+0000","last_unstale":"2023-06-09T04:38:11.910850+0000","last_undegraded":"2023-06-09T04:38:11.910850+0000","last_fullsized":"2023-06-09T04:38:11.910850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391373+0000","last_change":"2023-06-09T04:38:10.925006+0000","last_active":"2023-06-09T04:38:13.391373+0000","last_peered":"2023-06-09T04:38:13.391373+0000","last_clean":"2023-06-09T04:38:13.391373+0000","last_became_active":"2023-06-09T04:38:10.924722+0000","last_became_peered":"2023-06-09T04:38:10.924722+0000","last_unstale":"2023-06-09T04:38:13.391373+0000","last_undegraded":"2023-06-09T04:38:13.391373+0000","last_fullsized":"2023-06-09T04:38:13.391373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909443+0000","last_change":"2023-06-09T04:38:10.930759+0000","last_active":"2023-06-09T04:38:11.909443+0000","last_peered":"2023-06-09T04:38:11.909443+0000","last_clean":"2023-06-09T04:38:11.909443+0000","last_became_active":"2023-06-09T04:38:10.929148+0000","last_became_peered":"2023-06-09T04:38:10.929148+0000","last_unstale":"2023-06-09T04:38:11.909443+0000","last_undegraded":"2023-06-09T04:38:11.909443+0000","last_fullsized":"2023-06-09T04:38:11.909443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910880+0000","last_change":"2023-06-09T04:38:10.931056+0000","last_active":"2023-06-09T04:38:11.910880+0000","last_peered":"2023-06-09T04:38:11.910880+0000","last_clean":"2023-06-09T04:38:11.910880+0000","last_became_active":"2023-06-09T04:38:10.930774+0000","last_became_peered":"2023-06-09T04:38:10.930774+0000","last_unstale":"2023-06-09T04:38:11.910880+0000","last_undegraded":"2023-06-09T04:38:11.910880+0000","last_fullsized":"2023-06-09T04:38:11.910880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910828+0000","last_change":"2023-06-09T04:38:10.921511+0000","last_active":"2023-06-09T04:38:11.910828+0000","last_peered":"2023-06-09T04:38:11.910828+0000","last_clean":"2023-06-09T04:38:11.910828+0000","last_became_active":"2023-06-09T04:38:10.921227+0000","last_became_peered":"2023-06-09T04:38:10.921227+0000","last_unstale":"2023-06-09T04:38:11.910828+0000","last_undegraded":"2023-06-09T04:38:11.910828+0000","last_fullsized":"2023-06-09T04:38:11.910828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909763+0000","last_change":"2023-06-09T04:38:10.929993+0000","last_active":"2023-06-09T04:38:11.909763+0000","last_peered":"2023-06-09T04:38:11.909763+0000","last_clean":"2023-06-09T04:38:11.909763+0000","last_became_active":"2023-06-09T04:38:10.929714+0000","last_became_peered":"2023-06-09T04:38:10.929714+0000","last_unstale":"2023-06-09T04:38:11.909763+0000","last_undegraded":"2023-06-09T04:38:11.909763+0000","last_fullsized":"2023-06-09T04:38:11.909763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391564+0000","last_change":"2023-06-09T04:38:10.925046+0000","last_active":"2023-06-09T04:38:13.391564+0000","last_peered":"2023-06-09T04:38:13.391564+0000","last_clean":"2023-06-09T04:38:13.391564+0000","last_became_active":"2023-06-09T04:38:10.924778+0000","last_became_peered":"2023-06-09T04:38:10.924778+0000","last_unstale":"2023-06-09T04:38:13.391564+0000","last_undegraded":"2023-06-09T04:38:13.391564+0000","last_fullsized":"2023-06-09T04:38:13.391564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910514+0000","last_change":"2023-06-09T04:38:10.922498+0000","last_active":"2023-06-09T04:38:11.910514+0000","last_peered":"2023-06-09T04:38:11.910514+0000","last_clean":"2023-06-09T04:38:11.910514+0000","last_became_active":"2023-06-09T04:38:10.922213+0000","last_became_peered":"2023-06-09T04:38:10.922213+0000","last_unstale":"2023-06-09T04:38:11.910514+0000","last_undegraded":"2023-06-09T04:38:11.910514+0000","last_fullsized":"2023-06-09T04:38:11.910514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911226+0000","last_change":"2023-06-09T04:38:10.915953+0000","last_active":"2023-06-09T04:38:11.911226+0000","last_peered":"2023-06-09T04:38:11.911226+0000","last_clean":"2023-06-09T04:38:11.911226+0000","last_became_active":"2023-06-09T04:38:10.915766+0000","last_became_peered":"2023-06-09T04:38:10.915766+0000","last_unstale":"2023-06-09T04:38:11.911226+0000","last_undegraded":"2023-06-09T04:38:11.911226+0000","last_fullsized":"2023-06-09T04:38:11.911226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911141+0000","last_change":"2023-06-09T04:38:10.933155+0000","last_active":"2023-06-09T04:38:11.911141+0000","last_peered":"2023-06-09T04:38:11.911141+0000","last_clean":"2023-06-09T04:38:11.911141+0000","last_became_active":"2023-06-09T04:38:10.932888+0000","last_became_peered":"2023-06-09T04:38:10.932888+0000","last_unstale":"2023-06-09T04:38:11.911141+0000","last_undegraded":"2023-06-09T04:38:11.911141+0000","last_fullsized":"2023-06-09T04:38:11.911141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391513+0000","last_change":"2023-06-09T04:38:10.932591+0000","last_active":"2023-06-09T04:38:13.391513+0000","last_peered":"2023-06-09T04:38:13.391513+0000","last_clean":"2023-06-09T04:38:13.391513+0000","last_became_active":"2023-06-09T04:38:10.932015+0000","last_became_peered":"2023-06-09T04:38:10.932015+0000","last_unstale":"2023-06-09T04:38:13.391513+0000","last_undegraded":"2023-06-09T04:38:13.391513+0000","last_fullsized":"2023-06-09T04:38:13.391513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391385+0000","last_change":"2023-06-09T04:38:10.931034+0000","last_active":"2023-06-09T04:38:13.391385+0000","last_peered":"2023-06-09T04:38:13.391385+0000","last_clean":"2023-06-09T04:38:13.391385+0000","last_became_active":"2023-06-09T04:38:10.930771+0000","last_became_peered":"2023-06-09T04:38:10.930771+0000","last_unstale":"2023-06-09T04:38:13.391385+0000","last_undegraded":"2023-06-09T04:38:13.391385+0000","last_fullsized":"2023-06-09T04:38:13.391385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909735+0000","last_change":"2023-06-09T04:38:10.934995+0000","last_active":"2023-06-09T04:38:11.909735+0000","last_peered":"2023-06-09T04:38:11.909735+0000","last_clean":"2023-06-09T04:38:11.909735+0000","last_became_active":"2023-06-09T04:38:10.934540+0000","last_became_peered":"2023-06-09T04:38:10.934540+0000","last_unstale":"2023-06-09T04:38:11.909735+0000","last_undegraded":"2023-06-09T04:38:11.909735+0000","last_fullsized":"2023-06-09T04:38:11.909735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911099+0000","last_change":"2023-06-09T04:38:10.504205+0000","last_active":"2023-06-09T04:38:11.911099+0000","last_peered":"2023-06-09T04:38:11.911099+0000","last_clean":"2023-06-09T04:38:11.911099+0000","last_became_active":"2023-06-09T04:38:10.503938+0000","last_became_peered":"2023-06-09T04:38:10.503938+0000","last_unstale":"2023-06-09T04:38:11.911099+0000","last_undegraded":"2023-06-09T04:38:11.911099+0000","last_fullsized":"2023-06-09T04:38:11.911099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412810+0000","last_change":"2023-06-09T04:38:10.931680+0000","last_active":"2023-06-09T04:38:13.412810+0000","last_peered":"2023-06-09T04:38:13.412810+0000","last_clean":"2023-06-09T04:38:13.412810+0000","last_became_active":"2023-06-09T04:38:10.931384+0000","last_became_peered":"2023-06-09T04:38:10.931384+0000","last_unstale":"2023-06-09T04:38:13.412810+0000","last_undegraded":"2023-06-09T04:38:13.412810+0000","last_fullsized":"2023-06-09T04:38:13.412810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910743+0000","last_change":"2023-06-09T04:38:10.504164+0000","last_active":"2023-06-09T04:38:11.910743+0000","last_peered":"2023-06-09T04:38:11.910743+0000","last_clean":"2023-06-09T04:38:11.910743+0000","last_became_active":"2023-06-09T04:38:10.503860+0000","last_became_peered":"2023-06-09T04:38:10.503860+0000","last_unstale":"2023-06-09T04:38:11.910743+0000","last_undegraded":"2023-06-09T04:38:11.910743+0000","last_fullsized":"2023-06-09T04:38:11.910743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391720+0000","last_change":"2023-06-09T04:38:10.503304+0000","last_active":"2023-06-09T04:38:13.391720+0000","last_peered":"2023-06-09T04:38:13.391720+0000","last_clean":"2023-06-09T04:38:13.391720+0000","last_became_active":"2023-06-09T04:38:10.503023+0000","last_became_peered":"2023-06-09T04:38:10.503023+0000","last_unstale":"2023-06-09T04:38:13.391720+0000","last_undegraded":"2023-06-09T04:38:13.391720+0000","last_fullsized":"2023-06-09T04:38:13.391720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:15.493783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911309+0000","last_change":"2023-06-09T04:38:10.506797+0000","last_active":"2023-06-09T04:38:11.911309+0000","last_peered":"2023-06-09T04:38:11.911309+0000","last_clean":"2023-06-09T04:38:11.911309+0000","last_became_active":"2023-06-09T04:38:10.506436+0000","last_became_peered":"2023-06-09T04:38:10.506436+0000","last_unstale":"2023-06-09T04:38:11.911309+0000","last_undegraded":"2023-06-09T04:38:11.911309+0000","last_fullsized":"2023-06-09T04:38:11.911309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:09:17.732730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911246+0000","last_change":"2023-06-09T04:38:10.925785+0000","last_active":"2023-06-09T04:38:11.911246+0000","last_peered":"2023-06-09T04:38:11.911246+0000","last_clean":"2023-06-09T04:38:11.911246+0000","last_became_active":"2023-06-09T04:38:10.925512+0000","last_became_peered":"2023-06-09T04:38:10.925512+0000","last_unstale":"2023-06-09T04:38:11.911246+0000","last_undegraded":"2023-06-09T04:38:11.911246+0000","last_fullsized":"2023-06-09T04:38:11.911246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:31.914046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391558+0000","last_change":"2023-06-09T04:38:10.505311+0000","last_active":"2023-06-09T04:38:13.391558+0000","last_peered":"2023-06-09T04:38:13.391558+0000","last_clean":"2023-06-09T04:38:13.391558+0000","last_became_active":"2023-06-09T04:38:10.505022+0000","last_became_peered":"2023-06-09T04:38:10.505022+0000","last_unstale":"2023-06-09T04:38:13.391558+0000","last_undegraded":"2023-06-09T04:38:13.391558+0000","last_fullsized":"2023-06-09T04:38:13.391558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909893+0000","last_change":"2023-06-09T04:38:10.934791+0000","last_active":"2023-06-09T04:38:11.909893+0000","last_peered":"2023-06-09T04:38:11.909893+0000","last_clean":"2023-06-09T04:38:11.909893+0000","last_became_active":"2023-06-09T04:38:10.934178+0000","last_became_peered":"2023-06-09T04:38:10.934178+0000","last_unstale":"2023-06-09T04:38:11.909893+0000","last_undegraded":"2023-06-09T04:38:11.909893+0000","last_fullsized":"2023-06-09T04:38:11.909893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391381+0000","last_change":"2023-06-09T04:38:10.504977+0000","last_active":"2023-06-09T04:38:13.391381+0000","last_peered":"2023-06-09T04:38:13.391381+0000","last_clean":"2023-06-09T04:38:13.391381+0000","last_became_active":"2023-06-09T04:38:10.504701+0000","last_became_peered":"2023-06-09T04:38:10.504701+0000","last_unstale":"2023-06-09T04:38:13.391381+0000","last_undegraded":"2023-06-09T04:38:13.391381+0000","last_fullsized":"2023-06-09T04:38:13.391381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412380+0000","last_change":"2023-06-09T04:38:10.500330+0000","last_active":"2023-06-09T04:38:13.412380+0000","last_peered":"2023-06-09T04:38:13.412380+0000","last_clean":"2023-06-09T04:38:13.412380+0000","last_became_active":"2023-06-09T04:38:10.500022+0000","last_became_peered":"2023-06-09T04:38:10.500022+0000","last_unstale":"2023-06-09T04:38:13.412380+0000","last_undegraded":"2023-06-09T04:38:13.412380+0000","last_fullsized":"2023-06-09T04:38:13.412380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391817+0000","last_change":"2023-06-09T04:38:10.505087+0000","last_active":"2023-06-09T04:38:13.391817+0000","last_peered":"2023-06-09T04:38:13.391817+0000","last_clean":"2023-06-09T04:38:13.391817+0000","last_became_active":"2023-06-09T04:38:10.504755+0000","last_became_peered":"2023-06-09T04:38:10.504755+0000","last_unstale":"2023-06-09T04:38:13.391817+0000","last_undegraded":"2023-06-09T04:38:13.391817+0000","last_fullsized":"2023-06-09T04:38:13.391817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:39.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909442+0000","last_change":"2023-06-09T04:38:10.929326+0000","last_active":"2023-06-09T04:38:11.909442+0000","last_peered":"2023-06-09T04:38:11.909442+0000","last_clean":"2023-06-09T04:38:11.909442+0000","last_became_active":"2023-06-09T04:38:10.928834+0000","last_became_peered":"2023-06-09T04:38:10.928834+0000","last_unstale":"2023-06-09T04:38:11.909442+0000","last_undegraded":"2023-06-09T04:38:11.909442+0000","last_fullsized":"2023-06-09T04:38:11.909442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391766+0000","last_change":"2023-06-09T04:38:10.506206+0000","last_active":"2023-06-09T04:38:13.391766+0000","last_peered":"2023-06-09T04:38:13.391766+0000","last_clean":"2023-06-09T04:38:13.391766+0000","last_became_active":"2023-06-09T04:38:10.505918+0000","last_became_peered":"2023-06-09T04:38:10.505918+0000","last_unstale":"2023-06-09T04:38:13.391766+0000","last_undegraded":"2023-06-09T04:38:13.391766+0000","last_fullsized":"2023-06-09T04:38:13.391766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:30.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910637+0000","last_change":"2023-06-09T04:38:10.926825+0000","last_active":"2023-06-09T04:38:11.910637+0000","last_peered":"2023-06-09T04:38:11.910637+0000","last_clean":"2023-06-09T04:38:11.910637+0000","last_became_active":"2023-06-09T04:38:10.925259+0000","last_became_peered":"2023-06-09T04:38:10.925259+0000","last_unstale":"2023-06-09T04:38:11.910637+0000","last_undegraded":"2023-06-09T04:38:11.910637+0000","last_fullsized":"2023-06-09T04:38:11.910637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391712+0000","last_change":"2023-06-09T04:38:10.509517+0000","last_active":"2023-06-09T04:38:13.391712+0000","last_peered":"2023-06-09T04:38:13.391712+0000","last_clean":"2023-06-09T04:38:13.391712+0000","last_became_active":"2023-06-09T04:38:10.509176+0000","last_became_peered":"2023-06-09T04:38:10.509176+0000","last_unstale":"2023-06-09T04:38:13.391712+0000","last_undegraded":"2023-06-09T04:38:13.391712+0000","last_fullsized":"2023-06-09T04:38:13.391712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412583+0000","last_change":"2023-06-09T04:38:10.931892+0000","last_active":"2023-06-09T04:38:13.412583+0000","last_peered":"2023-06-09T04:38:13.412583+0000","last_clean":"2023-06-09T04:38:13.412583+0000","last_became_active":"2023-06-09T04:38:10.931582+0000","last_became_peered":"2023-06-09T04:38:10.931582+0000","last_unstale":"2023-06-09T04:38:13.412583+0000","last_undegraded":"2023-06-09T04:38:13.412583+0000","last_fullsized":"2023-06-09T04:38:13.412583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909739+0000","last_change":"2023-06-09T04:38:10.499293+0000","last_active":"2023-06-09T04:38:11.909739+0000","last_peered":"2023-06-09T04:38:11.909739+0000","last_clean":"2023-06-09T04:38:11.909739+0000","last_became_active":"2023-06-09T04:38:10.498975+0000","last_became_peered":"2023-06-09T04:38:10.498975+0000","last_unstale":"2023-06-09T04:38:11.909739+0000","last_undegraded":"2023-06-09T04:38:11.909739+0000","last_fullsized":"2023-06-09T04:38:11.909739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911455+0000","last_change":"2023-06-09T04:38:10.923193+0000","last_active":"2023-06-09T04:38:11.911455+0000","last_peered":"2023-06-09T04:38:11.911455+0000","last_clean":"2023-06-09T04:38:11.911455+0000","last_became_active":"2023-06-09T04:38:10.922990+0000","last_became_peered":"2023-06-09T04:38:10.922990+0000","last_unstale":"2023-06-09T04:38:11.911455+0000","last_undegraded":"2023-06-09T04:38:11.911455+0000","last_fullsized":"2023-06-09T04:38:11.911455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:23:12.547612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412527+0000","last_change":"2023-06-09T04:38:10.505164+0000","last_active":"2023-06-09T04:38:13.412527+0000","last_peered":"2023-06-09T04:38:13.412527+0000","last_clean":"2023-06-09T04:38:13.412527+0000","last_became_active":"2023-06-09T04:38:10.504811+0000","last_became_peered":"2023-06-09T04:38:10.504811+0000","last_unstale":"2023-06-09T04:38:13.412527+0000","last_undegraded":"2023-06-09T04:38:13.412527+0000","last_fullsized":"2023-06-09T04:38:13.412527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911040+0000","last_change":"2023-06-09T04:38:10.920127+0000","last_active":"2023-06-09T04:38:11.911040+0000","last_peered":"2023-06-09T04:38:11.911040+0000","last_clean":"2023-06-09T04:38:11.911040+0000","last_became_active":"2023-06-09T04:38:10.919772+0000","last_became_peered":"2023-06-09T04:38:10.919772+0000","last_unstale":"2023-06-09T04:38:11.911040+0000","last_undegraded":"2023-06-09T04:38:11.911040+0000","last_fullsized":"2023-06-09T04:38:11.911040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911204+0000","last_change":"2023-06-09T04:38:10.501469+0000","last_active":"2023-06-09T04:38:11.911204+0000","last_peered":"2023-06-09T04:38:11.911204+0000","last_clean":"2023-06-09T04:38:11.911204+0000","last_became_active":"2023-06-09T04:38:10.500744+0000","last_became_peered":"2023-06-09T04:38:10.500744+0000","last_unstale":"2023-06-09T04:38:11.911204+0000","last_undegraded":"2023-06-09T04:38:11.911204+0000","last_fullsized":"2023-06-09T04:38:11.911204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911324+0000","last_change":"2023-06-09T04:38:10.929971+0000","last_active":"2023-06-09T04:38:11.911324+0000","last_peered":"2023-06-09T04:38:11.911324+0000","last_clean":"2023-06-09T04:38:11.911324+0000","last_became_active":"2023-06-09T04:38:10.929603+0000","last_became_peered":"2023-06-09T04:38:10.929603+0000","last_unstale":"2023-06-09T04:38:11.911324+0000","last_undegraded":"2023-06-09T04:38:11.911324+0000","last_fullsized":"2023-06-09T04:38:11.911324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:43:02.835123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910907+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:11.910907+0000","last_peered":"2023-06-09T04:38:11.910907+0000","last_clean":"2023-06-09T04:38:11.910907+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:11.910907+0000","last_undegraded":"2023-06-09T04:38:11.910907+0000","last_fullsized":"2023-06-09T04:38:11.910907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:32.018222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922981+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:12.922981+0000","last_peered":"2023-06-09T04:38:12.922981+0000","last_clean":"2023-06-09T04:38:12.922981+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:12.922981+0000","last_undegraded":"2023-06-09T04:38:12.922981+0000","last_fullsized":"2023-06-09T04:38:12.922981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911059+0000","last_change":"2023-06-09T04:38:10.925917+0000","last_active":"2023-06-09T04:38:11.911059+0000","last_peered":"2023-06-09T04:38:11.911059+0000","last_clean":"2023-06-09T04:38:11.911059+0000","last_became_active":"2023-06-09T04:38:10.925639+0000","last_became_peered":"2023-06-09T04:38:10.925639+0000","last_unstale":"2023-06-09T04:38:11.911059+0000","last_undegraded":"2023-06-09T04:38:11.911059+0000","last_fullsized":"2023-06-09T04:38:11.911059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391469+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:13.391469+0000","last_peered":"2023-06-09T04:38:13.391469+0000","last_clean":"2023-06-09T04:38:13.391469+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:13.391469+0000","last_undegraded":"2023-06-09T04:38:13.391469+0000","last_fullsized":"2023-06-09T04:38:13.391469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:08.271917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391303+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:13.391303+0000","last_peered":"2023-06-09T04:38:13.391303+0000","last_clean":"2023-06-09T04:38:13.391303+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:13.391303+0000","last_undegraded":"2023-06-09T04:38:13.391303+0000","last_fullsized":"2023-06-09T04:38:13.391303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:31.150602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391289+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:13.391289+0000","last_peered":"2023-06-09T04:38:13.391289+0000","last_clean":"2023-06-09T04:38:13.391289+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:13.391289+0000","last_undegraded":"2023-06-09T04:38:13.391289+0000","last_fullsized":"2023-06-09T04:38:13.391289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:02.934690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412689+0000","last_change":"2023-06-09T04:38:10.931667+0000","last_active":"2023-06-09T04:38:13.412689+0000","last_peered":"2023-06-09T04:38:13.412689+0000","last_clean":"2023-06-09T04:38:13.412689+0000","last_became_active":"2023-06-09T04:38:10.931312+0000","last_became_peered":"2023-06-09T04:38:10.931312+0000","last_unstale":"2023-06-09T04:38:13.412689+0000","last_undegraded":"2023-06-09T04:38:13.412689+0000","last_fullsized":"2023-06-09T04:38:13.412689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909605+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:11.909605+0000","last_peered":"2023-06-09T04:38:11.909605+0000","last_clean":"2023-06-09T04:38:11.909605+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:11.909605+0000","last_undegraded":"2023-06-09T04:38:11.909605+0000","last_fullsized":"2023-06-09T04:38:11.909605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:27:59.551499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911066+0000","last_change":"2023-06-09T04:38:10.500644+0000","last_active":"2023-06-09T04:38:11.911066+0000","last_peered":"2023-06-09T04:38:11.911066+0000","last_clean":"2023-06-09T04:38:11.911066+0000","last_became_active":"2023-06-09T04:38:10.500334+0000","last_became_peered":"2023-06-09T04:38:10.500334+0000","last_unstale":"2023-06-09T04:38:11.911066+0000","last_undegraded":"2023-06-09T04:38:11.911066+0000","last_fullsized":"2023-06-09T04:38:11.911066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:03.010329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412714+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:13.412714+0000","last_peered":"2023-06-09T04:38:13.412714+0000","last_clean":"2023-06-09T04:38:13.412714+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:13.412714+0000","last_undegraded":"2023-06-09T04:38:13.412714+0000","last_fullsized":"2023-06-09T04:38:13.412714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:15.845067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412260+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:13.412260+0000","last_peered":"2023-06-09T04:38:13.412260+0000","last_clean":"2023-06-09T04:38:13.412260+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:13.412260+0000","last_undegraded":"2023-06-09T04:38:13.412260+0000","last_fullsized":"2023-06-09T04:38:13.412260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:23.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909967+0000","last_change":"2023-06-09T04:38:10.497932+0000","last_active":"2023-06-09T04:38:11.909967+0000","last_peered":"2023-06-09T04:38:11.909967+0000","last_clean":"2023-06-09T04:38:11.909967+0000","last_became_active":"2023-06-09T04:38:10.497592+0000","last_became_peered":"2023-06-09T04:38:10.497592+0000","last_unstale":"2023-06-09T04:38:11.909967+0000","last_undegraded":"2023-06-09T04:38:11.909967+0000","last_fullsized":"2023-06-09T04:38:11.909967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909546+0000","last_change":"2023-06-09T04:38:10.502062+0000","last_active":"2023-06-09T04:38:11.909546+0000","last_peered":"2023-06-09T04:38:11.909546+0000","last_clean":"2023-06-09T04:38:11.909546+0000","last_became_active":"2023-06-09T04:38:10.501789+0000","last_became_peered":"2023-06-09T04:38:10.501789+0000","last_unstale":"2023-06-09T04:38:11.909546+0000","last_undegraded":"2023-06-09T04:38:11.909546+0000","last_fullsized":"2023-06-09T04:38:11.909546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:45.737873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910961+0000","last_change":"2023-06-09T04:38:10.928386+0000","last_active":"2023-06-09T04:38:11.910961+0000","last_peered":"2023-06-09T04:38:11.910961+0000","last_clean":"2023-06-09T04:38:11.910961+0000","last_became_active":"2023-06-09T04:38:10.928058+0000","last_became_peered":"2023-06-09T04:38:10.928058+0000","last_unstale":"2023-06-09T04:38:11.910961+0000","last_undegraded":"2023-06-09T04:38:11.910961+0000","last_fullsized":"2023-06-09T04:38:11.910961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910058+0000","last_change":"2023-06-09T04:38:10.501766+0000","last_active":"2023-06-09T04:38:11.910058+0000","last_peered":"2023-06-09T04:38:11.910058+0000","last_clean":"2023-06-09T04:38:11.910058+0000","last_became_active":"2023-06-09T04:38:10.501430+0000","last_became_peered":"2023-06-09T04:38:10.501430+0000","last_unstale":"2023-06-09T04:38:11.910058+0000","last_undegraded":"2023-06-09T04:38:11.910058+0000","last_fullsized":"2023-06-09T04:38:11.910058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911284+0000","last_change":"2023-06-09T04:38:10.923112+0000","last_active":"2023-06-09T04:38:11.911284+0000","last_peered":"2023-06-09T04:38:11.911284+0000","last_clean":"2023-06-09T04:38:11.911284+0000","last_became_active":"2023-06-09T04:38:10.922870+0000","last_became_peered":"2023-06-09T04:38:10.922870+0000","last_unstale":"2023-06-09T04:38:11.911284+0000","last_undegraded":"2023-06-09T04:38:11.911284+0000","last_fullsized":"2023-06-09T04:38:11.911284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910580+0000","last_change":"2023-06-09T04:38:10.932621+0000","last_active":"2023-06-09T04:38:11.910580+0000","last_peered":"2023-06-09T04:38:11.910580+0000","last_clean":"2023-06-09T04:38:11.910580+0000","last_became_active":"2023-06-09T04:38:10.932338+0000","last_became_peered":"2023-06-09T04:38:10.932338+0000","last_unstale":"2023-06-09T04:38:11.910580+0000","last_undegraded":"2023-06-09T04:38:11.910580+0000","last_fullsized":"2023-06-09T04:38:11.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412500+0000","last_change":"2023-06-09T04:38:10.924992+0000","last_active":"2023-06-09T04:38:13.412500+0000","last_peered":"2023-06-09T04:38:13.412500+0000","last_clean":"2023-06-09T04:38:13.412500+0000","last_became_active":"2023-06-09T04:38:10.924719+0000","last_became_peered":"2023-06-09T04:38:10.924719+0000","last_unstale":"2023-06-09T04:38:13.412500+0000","last_undegraded":"2023-06-09T04:38:13.412500+0000","last_fullsized":"2023-06-09T04:38:13.412500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911138+0000","last_change":"2023-06-09T04:38:10.933162+0000","last_active":"2023-06-09T04:38:11.911138+0000","last_peered":"2023-06-09T04:38:11.911138+0000","last_clean":"2023-06-09T04:38:11.911138+0000","last_became_active":"2023-06-09T04:38:10.932932+0000","last_became_peered":"2023-06-09T04:38:10.932932+0000","last_unstale":"2023-06-09T04:38:11.911138+0000","last_undegraded":"2023-06-09T04:38:11.911138+0000","last_fullsized":"2023-06-09T04:38:11.911138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":835584,"data_stored":670127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":70747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":70165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":79599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":78631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:17.621 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:17.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:19.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:19.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.802+0000 7fa064eb6700 1 Processor -- start 2023-06-09T04:38:19.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.802+0000 7fa064eb6700 1 -- start start 2023-06-09T04:38:19.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa064eb6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa060069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa064eb6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa06006a3d0 0x7fa0600ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa064eb6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600cd4f0 con 0x7fa0600cd0a0 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa064eb6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06015d4d0 con 0x7fa06006a3d0 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa064eb6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa060158e60 con 0x7fa060158a90 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa06006a3d0 0x7fa0600ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa0600cd0a0 0x7fa060070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46660/0 (socket says 172.21.15.26:46660) 2023-06-09T04:38:19.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa06006a3d0 0x7fa0600ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37800/0 (socket says 172.21.15.26:37800) 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05ed9d700 1 -- 172.21.15.26:0/3233392863 learned_addr learned my addr 172.21.15.26:0/3233392863 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05e59c700 1 --2- 172.21.15.26:0/3233392863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa060069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 -- 172.21.15.26:0/3233392863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 msgr2=0x7fa060069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 --2- 172.21.15.26:0/3233392863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa060069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 -- 172.21.15.26:0/3233392863 >> v1:172.21.15.26:6789/0 conn(0x7fa0600cd0a0 legacy=0x7fa060070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 -- 172.21.15.26:0/3233392863 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06015c5e0 con 0x7fa06006a3d0 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05d59a700 1 -- 172.21.15.26:0/3233392863 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871030440 0 0) 0x7fa058001490 con 0x7fa0600cd0a0 2023-06-09T04:38:19.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.803+0000 7fa05dd9b700 1 --2- 172.21.15.26:0/3233392863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa0600ccb60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa054009840 tx=0x7fa054009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9eae926f3534e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:19.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa05d59a700 1 -- 172.21.15.26:0/3233392863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054011830 con 0x7fa06006a3d0 2023-06-09T04:38:19.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa05d59a700 1 -- 172.21.15.26:0/3233392863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054011990 con 0x7fa06006a3d0 2023-06-09T04:38:19.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa05d59a700 1 -- 172.21.15.26:0/3233392863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054011d20 con 0x7fa06006a3d0 2023-06-09T04:38:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 -- 172.21.15.26:0/3233392863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 msgr2=0x7fa0600ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3233392863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa0600ccb60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa054009840 tx=0x7fa054009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 -- 172.21.15.26:0/3233392863 shutdown_connections 2023-06-09T04:38:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3233392863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa060069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3233392863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa0600ccb60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 -- 172.21.15.26:0/3233392863 >> 172.21.15.26:0/3233392863 conn(0x7fa0600cbe20 msgr2=0x7fa0600ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 -- 172.21.15.26:0/3233392863 shutdown_connections 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.804+0000 7fa064eb6700 1 -- 172.21.15.26:0/3233392863 wait complete. 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 Processor -- start 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 -- start start 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa060156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0600cd0a0 0x7fa0601f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa0600a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601f2eb0 con 0x7fa06006a3d0 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601f3190 con 0x7fa0600cd0a0 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.806+0000 7fa064eb6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601f3470 con 0x7fa060158a90 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa060156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa060156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37804/0 (socket says 172.21.15.26:37804) 2023-06-09T04:38:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 -- 172.21.15.26:0/3642467499 learned_addr learned my addr 172.21.15.26:0/3642467499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05dd9b700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0600cd0a0 0x7fa0601f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 -- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 msgr2=0x7fa0600a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa0600a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 -- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0600cd0a0 msgr2=0x7fa0601f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0600cd0a0 0x7fa0601f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 -- 172.21.15.26:0/3642467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540094a0 con 0x7fa06006a3d0 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05dd9b700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0600cd0a0 0x7fa0601f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa05e59c700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa060156da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa05000e910 tx=0x7fa05000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000a690 con 0x7fa06006a3d0 2023-06-09T04:38:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000c940 con 0x7fa06006a3d0 2023-06-09T04:38:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0601f3750 con 0x7fa06006a3d0 2023-06-09T04:38:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000ccd0 con 0x7fa06006a3d0 2023-06-09T04:38:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.807+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0601f2b70 con 0x7fa06006a3d0 2023-06-09T04:38:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.808+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600aa5c0 con 0x7fa06006a3d0 2023-06-09T04:38:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.809+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0500113f0 con 0x7fa06006a3d0 2023-06-09T04:38:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.809+0000 7fa04effd700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.809+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa050088fd0 con 0x7fa06006a3d0 2023-06-09T04:38:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.810+0000 7fa05dd9b700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.810+0000 7fa05dd9b700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa04006ace0 0x7fa04006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa060157d10 tx=0x7fa054008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:19.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:19.814+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa050057b10 con 0x7fa06006a3d0 2023-06-09T04:38:20.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.005+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0601f3300 con 0x7fa04006ace0 2023-06-09T04:38:20.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.014+0000 7fa04effd700 1 -- 172.21.15.26:0/3642467499 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286841 (secure 0 0 0) 0x7fa0601f3300 con 0x7fa04006ace0 2023-06-09T04:38:20.017 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:20.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa04006ace0 msgr2=0x7fa04006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa04006ace0 0x7fa04006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa060157d10 tx=0x7fa054008030 comp rx=0 tx=0).stop 2023-06-09T04:38:20.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 msgr2=0x7fa060156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa060156da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa05000e910 tx=0x7fa05000ecd0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 shutdown_connections 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa060158a90 0x7fa0600a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa06006a3d0 0x7fa060156da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 --2- 172.21.15.26:0/3642467499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0600cd0a0 0x7fa0601f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 >> 172.21.15.26:0/3642467499 conn(0x7fa0600cbe20 msgr2=0x7fa06006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 shutdown_connections 2023-06-09T04:38:20.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.017+0000 7fa064eb6700 1 -- 172.21.15.26:0/3642467499 wait complete. 2023-06-09T04:38:20.021 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:20.030 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-06-09T04:38:19.875555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1806970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.968855"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910608+0000","last_change":"2023-06-09T04:38:10.931316+0000","last_active":"2023-06-09T04:38:11.910608+0000","last_peered":"2023-06-09T04:38:11.910608+0000","last_clean":"2023-06-09T04:38:11.910608+0000","last_became_active":"2023-06-09T04:38:10.930993+0000","last_became_peered":"2023-06-09T04:38:10.930993+0000","last_unstale":"2023-06-09T04:38:11.910608+0000","last_undegraded":"2023-06-09T04:38:11.910608+0000","last_fullsized":"2023-06-09T04:38:11.910608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910788+0000","last_change":"2023-06-09T04:38:10.922601+0000","last_active":"2023-06-09T04:38:11.910788+0000","last_peered":"2023-06-09T04:38:11.910788+0000","last_clean":"2023-06-09T04:38:11.910788+0000","last_became_active":"2023-06-09T04:38:10.922025+0000","last_became_peered":"2023-06-09T04:38:10.922025+0000","last_unstale":"2023-06-09T04:38:11.910788+0000","last_undegraded":"2023-06-09T04:38:11.910788+0000","last_fullsized":"2023-06-09T04:38:11.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412633+0000","last_change":"2023-06-09T04:38:10.931451+0000","last_active":"2023-06-09T04:38:13.412633+0000","last_peered":"2023-06-09T04:38:13.412633+0000","last_clean":"2023-06-09T04:38:13.412633+0000","last_became_active":"2023-06-09T04:38:10.931055+0000","last_became_peered":"2023-06-09T04:38:10.931055+0000","last_unstale":"2023-06-09T04:38:13.412633+0000","last_undegraded":"2023-06-09T04:38:13.412633+0000","last_fullsized":"2023-06-09T04:38:13.412633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910850+0000","last_change":"2023-06-09T04:38:10.922227+0000","last_active":"2023-06-09T04:38:11.910850+0000","last_peered":"2023-06-09T04:38:11.910850+0000","last_clean":"2023-06-09T04:38:11.910850+0000","last_became_active":"2023-06-09T04:38:10.921928+0000","last_became_peered":"2023-06-09T04:38:10.921928+0000","last_unstale":"2023-06-09T04:38:11.910850+0000","last_undegraded":"2023-06-09T04:38:11.910850+0000","last_fullsized":"2023-06-09T04:38:11.910850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391373+0000","last_change":"2023-06-09T04:38:10.925006+0000","last_active":"2023-06-09T04:38:13.391373+0000","last_peered":"2023-06-09T04:38:13.391373+0000","last_clean":"2023-06-09T04:38:13.391373+0000","last_became_active":"2023-06-09T04:38:10.924722+0000","last_became_peered":"2023-06-09T04:38:10.924722+0000","last_unstale":"2023-06-09T04:38:13.391373+0000","last_undegraded":"2023-06-09T04:38:13.391373+0000","last_fullsized":"2023-06-09T04:38:13.391373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909443+0000","last_change":"2023-06-09T04:38:10.930759+0000","last_active":"2023-06-09T04:38:11.909443+0000","last_peered":"2023-06-09T04:38:11.909443+0000","last_clean":"2023-06-09T04:38:11.909443+0000","last_became_active":"2023-06-09T04:38:10.929148+0000","last_became_peered":"2023-06-09T04:38:10.929148+0000","last_unstale":"2023-06-09T04:38:11.909443+0000","last_undegraded":"2023-06-09T04:38:11.909443+0000","last_fullsized":"2023-06-09T04:38:11.909443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910880+0000","last_change":"2023-06-09T04:38:10.931056+0000","last_active":"2023-06-09T04:38:11.910880+0000","last_peered":"2023-06-09T04:38:11.910880+0000","last_clean":"2023-06-09T04:38:11.910880+0000","last_became_active":"2023-06-09T04:38:10.930774+0000","last_became_peered":"2023-06-09T04:38:10.930774+0000","last_unstale":"2023-06-09T04:38:11.910880+0000","last_undegraded":"2023-06-09T04:38:11.910880+0000","last_fullsized":"2023-06-09T04:38:11.910880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910828+0000","last_change":"2023-06-09T04:38:10.921511+0000","last_active":"2023-06-09T04:38:11.910828+0000","last_peered":"2023-06-09T04:38:11.910828+0000","last_clean":"2023-06-09T04:38:11.910828+0000","last_became_active":"2023-06-09T04:38:10.921227+0000","last_became_peered":"2023-06-09T04:38:10.921227+0000","last_unstale":"2023-06-09T04:38:11.910828+0000","last_undegraded":"2023-06-09T04:38:11.910828+0000","last_fullsized":"2023-06-09T04:38:11.910828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909763+0000","last_change":"2023-06-09T04:38:10.929993+0000","last_active":"2023-06-09T04:38:11.909763+0000","last_peered":"2023-06-09T04:38:11.909763+0000","last_clean":"2023-06-09T04:38:11.909763+0000","last_became_active":"2023-06-09T04:38:10.929714+0000","last_became_peered":"2023-06-09T04:38:10.929714+0000","last_unstale":"2023-06-09T04:38:11.909763+0000","last_undegraded":"2023-06-09T04:38:11.909763+0000","last_fullsized":"2023-06-09T04:38:11.909763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391564+0000","last_change":"2023-06-09T04:38:10.925046+0000","last_active":"2023-06-09T04:38:13.391564+0000","last_peered":"2023-06-09T04:38:13.391564+0000","last_clean":"2023-06-09T04:38:13.391564+0000","last_became_active":"2023-06-09T04:38:10.924778+0000","last_became_peered":"2023-06-09T04:38:10.924778+0000","last_unstale":"2023-06-09T04:38:13.391564+0000","last_undegraded":"2023-06-09T04:38:13.391564+0000","last_fullsized":"2023-06-09T04:38:13.391564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910514+0000","last_change":"2023-06-09T04:38:10.922498+0000","last_active":"2023-06-09T04:38:11.910514+0000","last_peered":"2023-06-09T04:38:11.910514+0000","last_clean":"2023-06-09T04:38:11.910514+0000","last_became_active":"2023-06-09T04:38:10.922213+0000","last_became_peered":"2023-06-09T04:38:10.922213+0000","last_unstale":"2023-06-09T04:38:11.910514+0000","last_undegraded":"2023-06-09T04:38:11.910514+0000","last_fullsized":"2023-06-09T04:38:11.910514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911226+0000","last_change":"2023-06-09T04:38:10.915953+0000","last_active":"2023-06-09T04:38:11.911226+0000","last_peered":"2023-06-09T04:38:11.911226+0000","last_clean":"2023-06-09T04:38:11.911226+0000","last_became_active":"2023-06-09T04:38:10.915766+0000","last_became_peered":"2023-06-09T04:38:10.915766+0000","last_unstale":"2023-06-09T04:38:11.911226+0000","last_undegraded":"2023-06-09T04:38:11.911226+0000","last_fullsized":"2023-06-09T04:38:11.911226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911141+0000","last_change":"2023-06-09T04:38:10.933155+0000","last_active":"2023-06-09T04:38:11.911141+0000","last_peered":"2023-06-09T04:38:11.911141+0000","last_clean":"2023-06-09T04:38:11.911141+0000","last_became_active":"2023-06-09T04:38:10.932888+0000","last_became_peered":"2023-06-09T04:38:10.932888+0000","last_unstale":"2023-06-09T04:38:11.911141+0000","last_undegraded":"2023-06-09T04:38:11.911141+0000","last_fullsized":"2023-06-09T04:38:11.911141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391513+0000","last_change":"2023-06-09T04:38:10.932591+0000","last_active":"2023-06-09T04:38:13.391513+0000","last_peered":"2023-06-09T04:38:13.391513+0000","last_clean":"2023-06-09T04:38:13.391513+0000","last_became_active":"2023-06-09T04:38:10.932015+0000","last_became_peered":"2023-06-09T04:38:10.932015+0000","last_unstale":"2023-06-09T04:38:13.391513+0000","last_undegraded":"2023-06-09T04:38:13.391513+0000","last_fullsized":"2023-06-09T04:38:13.391513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391385+0000","last_change":"2023-06-09T04:38:10.931034+0000","last_active":"2023-06-09T04:38:13.391385+0000","last_peered":"2023-06-09T04:38:13.391385+0000","last_clean":"2023-06-09T04:38:13.391385+0000","last_became_active":"2023-06-09T04:38:10.930771+0000","last_became_peered":"2023-06-09T04:38:10.930771+0000","last_unstale":"2023-06-09T04:38:13.391385+0000","last_undegraded":"2023-06-09T04:38:13.391385+0000","last_fullsized":"2023-06-09T04:38:13.391385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909735+0000","last_change":"2023-06-09T04:38:10.934995+0000","last_active":"2023-06-09T04:38:11.909735+0000","last_peered":"2023-06-09T04:38:11.909735+0000","last_clean":"2023-06-09T04:38:11.909735+0000","last_became_active":"2023-06-09T04:38:10.934540+0000","last_became_peered":"2023-06-09T04:38:10.934540+0000","last_unstale":"2023-06-09T04:38:11.909735+0000","last_undegraded":"2023-06-09T04:38:11.909735+0000","last_fullsized":"2023-06-09T04:38:11.909735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911099+0000","last_change":"2023-06-09T04:38:10.504205+0000","last_active":"2023-06-09T04:38:11.911099+0000","last_peered":"2023-06-09T04:38:11.911099+0000","last_clean":"2023-06-09T04:38:11.911099+0000","last_became_active":"2023-06-09T04:38:10.503938+0000","last_became_peered":"2023-06-09T04:38:10.503938+0000","last_unstale":"2023-06-09T04:38:11.911099+0000","last_undegraded":"2023-06-09T04:38:11.911099+0000","last_fullsized":"2023-06-09T04:38:11.911099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412810+0000","last_change":"2023-06-09T04:38:10.931680+0000","last_active":"2023-06-09T04:38:13.412810+0000","last_peered":"2023-06-09T04:38:13.412810+0000","last_clean":"2023-06-09T04:38:13.412810+0000","last_became_active":"2023-06-09T04:38:10.931384+0000","last_became_peered":"2023-06-09T04:38:10.931384+0000","last_unstale":"2023-06-09T04:38:13.412810+0000","last_undegraded":"2023-06-09T04:38:13.412810+0000","last_fullsized":"2023-06-09T04:38:13.412810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910743+0000","last_change":"2023-06-09T04:38:10.504164+0000","last_active":"2023-06-09T04:38:11.910743+0000","last_peered":"2023-06-09T04:38:11.910743+0000","last_clean":"2023-06-09T04:38:11.910743+0000","last_became_active":"2023-06-09T04:38:10.503860+0000","last_became_peered":"2023-06-09T04:38:10.503860+0000","last_unstale":"2023-06-09T04:38:11.910743+0000","last_undegraded":"2023-06-09T04:38:11.910743+0000","last_fullsized":"2023-06-09T04:38:11.910743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391720+0000","last_change":"2023-06-09T04:38:10.503304+0000","last_active":"2023-06-09T04:38:13.391720+0000","last_peered":"2023-06-09T04:38:13.391720+0000","last_clean":"2023-06-09T04:38:13.391720+0000","last_became_active":"2023-06-09T04:38:10.503023+0000","last_became_peered":"2023-06-09T04:38:10.503023+0000","last_unstale":"2023-06-09T04:38:13.391720+0000","last_undegraded":"2023-06-09T04:38:13.391720+0000","last_fullsized":"2023-06-09T04:38:13.391720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:15.493783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911309+0000","last_change":"2023-06-09T04:38:10.506797+0000","last_active":"2023-06-09T04:38:11.911309+0000","last_peered":"2023-06-09T04:38:11.911309+0000","last_clean":"2023-06-09T04:38:11.911309+0000","last_became_active":"2023-06-09T04:38:10.506436+0000","last_became_peered":"2023-06-09T04:38:10.506436+0000","last_unstale":"2023-06-09T04:38:11.911309+0000","last_undegraded":"2023-06-09T04:38:11.911309+0000","last_fullsized":"2023-06-09T04:38:11.911309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:09:17.732730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911246+0000","last_change":"2023-06-09T04:38:10.925785+0000","last_active":"2023-06-09T04:38:11.911246+0000","last_peered":"2023-06-09T04:38:11.911246+0000","last_clean":"2023-06-09T04:38:11.911246+0000","last_became_active":"2023-06-09T04:38:10.925512+0000","last_became_peered":"2023-06-09T04:38:10.925512+0000","last_unstale":"2023-06-09T04:38:11.911246+0000","last_undegraded":"2023-06-09T04:38:11.911246+0000","last_fullsized":"2023-06-09T04:38:11.911246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:31.914046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391558+0000","last_change":"2023-06-09T04:38:10.505311+0000","last_active":"2023-06-09T04:38:13.391558+0000","last_peered":"2023-06-09T04:38:13.391558+0000","last_clean":"2023-06-09T04:38:13.391558+0000","last_became_active":"2023-06-09T04:38:10.505022+0000","last_became_peered":"2023-06-09T04:38:10.505022+0000","last_unstale":"2023-06-09T04:38:13.391558+0000","last_undegraded":"2023-06-09T04:38:13.391558+0000","last_fullsized":"2023-06-09T04:38:13.391558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909893+0000","last_change":"2023-06-09T04:38:10.934791+0000","last_active":"2023-06-09T04:38:11.909893+0000","last_peered":"2023-06-09T04:38:11.909893+0000","last_clean":"2023-06-09T04:38:11.909893+0000","last_became_active":"2023-06-09T04:38:10.934178+0000","last_became_peered":"2023-06-09T04:38:10.934178+0000","last_unstale":"2023-06-09T04:38:11.909893+0000","last_undegraded":"2023-06-09T04:38:11.909893+0000","last_fullsized":"2023-06-09T04:38:11.909893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391381+0000","last_change":"2023-06-09T04:38:10.504977+0000","last_active":"2023-06-09T04:38:13.391381+0000","last_peered":"2023-06-09T04:38:13.391381+0000","last_clean":"2023-06-09T04:38:13.391381+0000","last_became_active":"2023-06-09T04:38:10.504701+0000","last_became_peered":"2023-06-09T04:38:10.504701+0000","last_unstale":"2023-06-09T04:38:13.391381+0000","last_undegraded":"2023-06-09T04:38:13.391381+0000","last_fullsized":"2023-06-09T04:38:13.391381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412380+0000","last_change":"2023-06-09T04:38:10.500330+0000","last_active":"2023-06-09T04:38:13.412380+0000","last_peered":"2023-06-09T04:38:13.412380+0000","last_clean":"2023-06-09T04:38:13.412380+0000","last_became_active":"2023-06-09T04:38:10.500022+0000","last_became_peered":"2023-06-09T04:38:10.500022+0000","last_unstale":"2023-06-09T04:38:13.412380+0000","last_undegraded":"2023-06-09T04:38:13.412380+0000","last_fullsized":"2023-06-09T04:38:13.412380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391817+0000","last_change":"2023-06-09T04:38:10.505087+0000","last_active":"2023-06-09T04:38:13.391817+0000","last_peered":"2023-06-09T04:38:13.391817+0000","last_clean":"2023-06-09T04:38:13.391817+0000","last_became_active":"2023-06-09T04:38:10.504755+0000","last_became_peered":"2023-06-09T04:38:10.504755+0000","last_unstale":"2023-06-09T04:38:13.391817+0000","last_undegraded":"2023-06-09T04:38:13.391817+0000","last_fullsized":"2023-06-09T04:38:13.391817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:39.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909442+0000","last_change":"2023-06-09T04:38:10.929326+0000","last_active":"2023-06-09T04:38:11.909442+0000","last_peered":"2023-06-09T04:38:11.909442+0000","last_clean":"2023-06-09T04:38:11.909442+0000","last_became_active":"2023-06-09T04:38:10.928834+0000","last_became_peered":"2023-06-09T04:38:10.928834+0000","last_unstale":"2023-06-09T04:38:11.909442+0000","last_undegraded":"2023-06-09T04:38:11.909442+0000","last_fullsized":"2023-06-09T04:38:11.909442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391766+0000","last_change":"2023-06-09T04:38:10.506206+0000","last_active":"2023-06-09T04:38:13.391766+0000","last_peered":"2023-06-09T04:38:13.391766+0000","last_clean":"2023-06-09T04:38:13.391766+0000","last_became_active":"2023-06-09T04:38:10.505918+0000","last_became_peered":"2023-06-09T04:38:10.505918+0000","last_unstale":"2023-06-09T04:38:13.391766+0000","last_undegraded":"2023-06-09T04:38:13.391766+0000","last_fullsized":"2023-06-09T04:38:13.391766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:30.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910637+0000","last_change":"2023-06-09T04:38:10.926825+0000","last_active":"2023-06-09T04:38:11.910637+0000","last_peered":"2023-06-09T04:38:11.910637+0000","last_clean":"2023-06-09T04:38:11.910637+0000","last_became_active":"2023-06-09T04:38:10.925259+0000","last_became_peered":"2023-06-09T04:38:10.925259+0000","last_unstale":"2023-06-09T04:38:11.910637+0000","last_undegraded":"2023-06-09T04:38:11.910637+0000","last_fullsized":"2023-06-09T04:38:11.910637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391712+0000","last_change":"2023-06-09T04:38:10.509517+0000","last_active":"2023-06-09T04:38:13.391712+0000","last_peered":"2023-06-09T04:38:13.391712+0000","last_clean":"2023-06-09T04:38:13.391712+0000","last_became_active":"2023-06-09T04:38:10.509176+0000","last_became_peered":"2023-06-09T04:38:10.509176+0000","last_unstale":"2023-06-09T04:38:13.391712+0000","last_undegraded":"2023-06-09T04:38:13.391712+0000","last_fullsized":"2023-06-09T04:38:13.391712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412583+0000","last_change":"2023-06-09T04:38:10.931892+0000","last_active":"2023-06-09T04:38:13.412583+0000","last_peered":"2023-06-09T04:38:13.412583+0000","last_clean":"2023-06-09T04:38:13.412583+0000","last_became_active":"2023-06-09T04:38:10.931582+0000","last_became_peered":"2023-06-09T04:38:10.931582+0000","last_unstale":"2023-06-09T04:38:13.412583+0000","last_undegraded":"2023-06-09T04:38:13.412583+0000","last_fullsized":"2023-06-09T04:38:13.412583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909739+0000","last_change":"2023-06-09T04:38:10.499293+0000","last_active":"2023-06-09T04:38:11.909739+0000","last_peered":"2023-06-09T04:38:11.909739+0000","last_clean":"2023-06-09T04:38:11.909739+0000","last_became_active":"2023-06-09T04:38:10.498975+0000","last_became_peered":"2023-06-09T04:38:10.498975+0000","last_unstale":"2023-06-09T04:38:11.909739+0000","last_undegraded":"2023-06-09T04:38:11.909739+0000","last_fullsized":"2023-06-09T04:38:11.909739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911455+0000","last_change":"2023-06-09T04:38:10.923193+0000","last_active":"2023-06-09T04:38:11.911455+0000","last_peered":"2023-06-09T04:38:11.911455+0000","last_clean":"2023-06-09T04:38:11.911455+0000","last_became_active":"2023-06-09T04:38:10.922990+0000","last_became_peered":"2023-06-09T04:38:10.922990+0000","last_unstale":"2023-06-09T04:38:11.911455+0000","last_undegraded":"2023-06-09T04:38:11.911455+0000","last_fullsized":"2023-06-09T04:38:11.911455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:23:12.547612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412527+0000","last_change":"2023-06-09T04:38:10.505164+0000","last_active":"2023-06-09T04:38:13.412527+0000","last_peered":"2023-06-09T04:38:13.412527+0000","last_clean":"2023-06-09T04:38:13.412527+0000","last_became_active":"2023-06-09T04:38:10.504811+0000","last_became_peered":"2023-06-09T04:38:10.504811+0000","last_unstale":"2023-06-09T04:38:13.412527+0000","last_undegraded":"2023-06-09T04:38:13.412527+0000","last_fullsized":"2023-06-09T04:38:13.412527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911040+0000","last_change":"2023-06-09T04:38:10.920127+0000","last_active":"2023-06-09T04:38:11.911040+0000","last_peered":"2023-06-09T04:38:11.911040+0000","last_clean":"2023-06-09T04:38:11.911040+0000","last_became_active":"2023-06-09T04:38:10.919772+0000","last_became_peered":"2023-06-09T04:38:10.919772+0000","last_unstale":"2023-06-09T04:38:11.911040+0000","last_undegraded":"2023-06-09T04:38:11.911040+0000","last_fullsized":"2023-06-09T04:38:11.911040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911204+0000","last_change":"2023-06-09T04:38:10.501469+0000","last_active":"2023-06-09T04:38:11.911204+0000","last_peered":"2023-06-09T04:38:11.911204+0000","last_clean":"2023-06-09T04:38:11.911204+0000","last_became_active":"2023-06-09T04:38:10.500744+0000","last_became_peered":"2023-06-09T04:38:10.500744+0000","last_unstale":"2023-06-09T04:38:11.911204+0000","last_undegraded":"2023-06-09T04:38:11.911204+0000","last_fullsized":"2023-06-09T04:38:11.911204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911324+0000","last_change":"2023-06-09T04:38:10.929971+0000","last_active":"2023-06-09T04:38:11.911324+0000","last_peered":"2023-06-09T04:38:11.911324+0000","last_clean":"2023-06-09T04:38:11.911324+0000","last_became_active":"2023-06-09T04:38:10.929603+0000","last_became_peered":"2023-06-09T04:38:10.929603+0000","last_unstale":"2023-06-09T04:38:11.911324+0000","last_undegraded":"2023-06-09T04:38:11.911324+0000","last_fullsized":"2023-06-09T04:38:11.911324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:43:02.835123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910907+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:11.910907+0000","last_peered":"2023-06-09T04:38:11.910907+0000","last_clean":"2023-06-09T04:38:11.910907+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:11.910907+0000","last_undegraded":"2023-06-09T04:38:11.910907+0000","last_fullsized":"2023-06-09T04:38:11.910907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:32.018222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.048965+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:13.048965+0000","last_peered":"2023-06-09T04:38:13.048965+0000","last_clean":"2023-06-09T04:38:13.048965+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:13.048965+0000","last_undegraded":"2023-06-09T04:38:13.048965+0000","last_fullsized":"2023-06-09T04:38:13.048965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911059+0000","last_change":"2023-06-09T04:38:10.925917+0000","last_active":"2023-06-09T04:38:11.911059+0000","last_peered":"2023-06-09T04:38:11.911059+0000","last_clean":"2023-06-09T04:38:11.911059+0000","last_became_active":"2023-06-09T04:38:10.925639+0000","last_became_peered":"2023-06-09T04:38:10.925639+0000","last_unstale":"2023-06-09T04:38:11.911059+0000","last_undegraded":"2023-06-09T04:38:11.911059+0000","last_fullsized":"2023-06-09T04:38:11.911059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391469+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:13.391469+0000","last_peered":"2023-06-09T04:38:13.391469+0000","last_clean":"2023-06-09T04:38:13.391469+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:13.391469+0000","last_undegraded":"2023-06-09T04:38:13.391469+0000","last_fullsized":"2023-06-09T04:38:13.391469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:08.271917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391303+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:13.391303+0000","last_peered":"2023-06-09T04:38:13.391303+0000","last_clean":"2023-06-09T04:38:13.391303+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:13.391303+0000","last_undegraded":"2023-06-09T04:38:13.391303+0000","last_fullsized":"2023-06-09T04:38:13.391303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:31.150602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391289+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:13.391289+0000","last_peered":"2023-06-09T04:38:13.391289+0000","last_clean":"2023-06-09T04:38:13.391289+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:13.391289+0000","last_undegraded":"2023-06-09T04:38:13.391289+0000","last_fullsized":"2023-06-09T04:38:13.391289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:02.934690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412689+0000","last_change":"2023-06-09T04:38:10.931667+0000","last_active":"2023-06-09T04:38:13.412689+0000","last_peered":"2023-06-09T04:38:13.412689+0000","last_clean":"2023-06-09T04:38:13.412689+0000","last_became_active":"2023-06-09T04:38:10.931312+0000","last_became_peered":"2023-06-09T04:38:10.931312+0000","last_unstale":"2023-06-09T04:38:13.412689+0000","last_undegraded":"2023-06-09T04:38:13.412689+0000","last_fullsized":"2023-06-09T04:38:13.412689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909605+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:11.909605+0000","last_peered":"2023-06-09T04:38:11.909605+0000","last_clean":"2023-06-09T04:38:11.909605+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:11.909605+0000","last_undegraded":"2023-06-09T04:38:11.909605+0000","last_fullsized":"2023-06-09T04:38:11.909605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:27:59.551499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911066+0000","last_change":"2023-06-09T04:38:10.500644+0000","last_active":"2023-06-09T04:38:11.911066+0000","last_peered":"2023-06-09T04:38:11.911066+0000","last_clean":"2023-06-09T04:38:11.911066+0000","last_became_active":"2023-06-09T04:38:10.500334+0000","last_became_peered":"2023-06-09T04:38:10.500334+0000","last_unstale":"2023-06-09T04:38:11.911066+0000","last_undegraded":"2023-06-09T04:38:11.911066+0000","last_fullsized":"2023-06-09T04:38:11.911066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:03.010329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412714+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:13.412714+0000","last_peered":"2023-06-09T04:38:13.412714+0000","last_clean":"2023-06-09T04:38:13.412714+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:13.412714+0000","last_undegraded":"2023-06-09T04:38:13.412714+0000","last_fullsized":"2023-06-09T04:38:13.412714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:15.845067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412260+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:13.412260+0000","last_peered":"2023-06-09T04:38:13.412260+0000","last_clean":"2023-06-09T04:38:13.412260+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:13.412260+0000","last_undegraded":"2023-06-09T04:38:13.412260+0000","last_fullsized":"2023-06-09T04:38:13.412260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:23.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909967+0000","last_change":"2023-06-09T04:38:10.497932+0000","last_active":"2023-06-09T04:38:11.909967+0000","last_peered":"2023-06-09T04:38:11.909967+0000","last_clean":"2023-06-09T04:38:11.909967+0000","last_became_active":"2023-06-09T04:38:10.497592+0000","last_became_peered":"2023-06-09T04:38:10.497592+0000","last_unstale":"2023-06-09T04:38:11.909967+0000","last_undegraded":"2023-06-09T04:38:11.909967+0000","last_fullsized":"2023-06-09T04:38:11.909967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909546+0000","last_change":"2023-06-09T04:38:10.502062+0000","last_active":"2023-06-09T04:38:11.909546+0000","last_peered":"2023-06-09T04:38:11.909546+0000","last_clean":"2023-06-09T04:38:11.909546+0000","last_became_active":"2023-06-09T04:38:10.501789+0000","last_became_peered":"2023-06-09T04:38:10.501789+0000","last_unstale":"2023-06-09T04:38:11.909546+0000","last_undegraded":"2023-06-09T04:38:11.909546+0000","last_fullsized":"2023-06-09T04:38:11.909546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:45.737873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910961+0000","last_change":"2023-06-09T04:38:10.928386+0000","last_active":"2023-06-09T04:38:11.910961+0000","last_peered":"2023-06-09T04:38:11.910961+0000","last_clean":"2023-06-09T04:38:11.910961+0000","last_became_active":"2023-06-09T04:38:10.928058+0000","last_became_peered":"2023-06-09T04:38:10.928058+0000","last_unstale":"2023-06-09T04:38:11.910961+0000","last_undegraded":"2023-06-09T04:38:11.910961+0000","last_fullsized":"2023-06-09T04:38:11.910961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910058+0000","last_change":"2023-06-09T04:38:10.501766+0000","last_active":"2023-06-09T04:38:11.910058+0000","last_peered":"2023-06-09T04:38:11.910058+0000","last_clean":"2023-06-09T04:38:11.910058+0000","last_became_active":"2023-06-09T04:38:10.501430+0000","last_became_peered":"2023-06-09T04:38:10.501430+0000","last_unstale":"2023-06-09T04:38:11.910058+0000","last_undegraded":"2023-06-09T04:38:11.910058+0000","last_fullsized":"2023-06-09T04:38:11.910058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911284+0000","last_change":"2023-06-09T04:38:10.923112+0000","last_active":"2023-06-09T04:38:11.911284+0000","last_peered":"2023-06-09T04:38:11.911284+0000","last_clean":"2023-06-09T04:38:11.911284+0000","last_became_active":"2023-06-09T04:38:10.922870+0000","last_became_peered":"2023-06-09T04:38:10.922870+0000","last_unstale":"2023-06-09T04:38:11.911284+0000","last_undegraded":"2023-06-09T04:38:11.911284+0000","last_fullsized":"2023-06-09T04:38:11.911284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910580+0000","last_change":"2023-06-09T04:38:10.932621+0000","last_active":"2023-06-09T04:38:11.910580+0000","last_peered":"2023-06-09T04:38:11.910580+0000","last_clean":"2023-06-09T04:38:11.910580+0000","last_became_active":"2023-06-09T04:38:10.932338+0000","last_became_peered":"2023-06-09T04:38:10.932338+0000","last_unstale":"2023-06-09T04:38:11.910580+0000","last_undegraded":"2023-06-09T04:38:11.910580+0000","last_fullsized":"2023-06-09T04:38:11.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412500+0000","last_change":"2023-06-09T04:38:10.924992+0000","last_active":"2023-06-09T04:38:13.412500+0000","last_peered":"2023-06-09T04:38:13.412500+0000","last_clean":"2023-06-09T04:38:13.412500+0000","last_became_active":"2023-06-09T04:38:10.924719+0000","last_became_peered":"2023-06-09T04:38:10.924719+0000","last_unstale":"2023-06-09T04:38:13.412500+0000","last_undegraded":"2023-06-09T04:38:13.412500+0000","last_fullsized":"2023-06-09T04:38:13.412500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911138+0000","last_change":"2023-06-09T04:38:10.933162+0000","last_active":"2023-06-09T04:38:11.911138+0000","last_peered":"2023-06-09T04:38:11.911138+0000","last_clean":"2023-06-09T04:38:11.911138+0000","last_became_active":"2023-06-09T04:38:10.932932+0000","last_became_peered":"2023-06-09T04:38:10.932932+0000","last_unstale":"2023-06-09T04:38:11.911138+0000","last_undegraded":"2023-06-09T04:38:11.911138+0000","last_fullsized":"2023-06-09T04:38:11.911138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":835584,"data_stored":670127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":76818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":79599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":78631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:20.036 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:38:20.036 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-09T04:38:20.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-09T04:38:20.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-09T04:38:20.037 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-09T04:38:20.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.193+0000 7ffb79b43700 1 Processor -- start 2023-06-09T04:38:20.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.193+0000 7ffb79b43700 1 -- start start 2023-06-09T04:38:20.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb79b43700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffb7406e990 0x7ffb7406a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb79b43700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7406f190 con 0x7ffb740aed50 2023-06-09T04:38:20.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb79b43700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7406e440 con 0x7ffb7415c6e0 2023-06-09T04:38:20.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb79b43700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7406e690 con 0x7ffb7406e990 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb72ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffb740aed50 0x7ffb74069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46670/0 (socket says 172.21.15.26:46670) 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb72ffd700 1 -- 172.21.15.26:0/1229093207 learned_addr learned my addr 172.21.15.26:0/1229093207 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb73fff700 1 --2- 172.21.15.26:0/1229093207 >> v2:172.21.15.104:3300/0 conn(0x7ffb7406e990 0x7ffb7406a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977054709 0 0) 0x7ffb7406f190 con 0x7ffb740aed50 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c0035b0 con 0x7ffb740aed50 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170846471 0 0) 0x7ffb7406e440 con 0x7ffb7415c6e0 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb7406f190 con 0x7ffb7415c6e0 2023-06-09T04:38:20.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837472419 0 0) 0x7ffb5c0035b0 con 0x7ffb740aed50 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 >> v2:172.21.15.104:3300/0 conn(0x7ffb7406e990 msgr2=0x7ffb7406a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 --2- 172.21.15.26:0/1229093207 >> v2:172.21.15.104:3300/0 conn(0x7ffb7406e990 0x7ffb7406a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 >> v1:172.21.15.104:6789/0 conn(0x7ffb7415c6e0 legacy=0x7ffb740ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74160300 con 0x7ffb740aed50 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7ffb64001670 con 0x7ffb740aed50 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 >> v1:172.21.15.26:6789/0 conn(0x7ffb740aed50 legacy=0x7ffb74069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb5c003be0 0x7ffb5c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb5c004850 0x7ffb5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c005250 0x7ffb5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7406e690 con 0x7ffb5c003be0 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c00c160 con 0x7ffb5c004850 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c00c320 con 0x7ffb5c005250 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb737fe700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb5c003be0 0x7ffb5c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.194+0000 7ffb72ffd700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb5c004850 0x7ffb5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb73fff700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c005250 0x7ffb5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb737fe700 1 -- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c005250 msgr2=0x7ffb5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb737fe700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c005250 0x7ffb5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb737fe700 1 -- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb5c004850 msgr2=0x7ffb5c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb737fe700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb5c004850 0x7ffb5c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb73fff700 1 -- 172.21.15.26:0/1229093207 reap_dead start 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb737fe700 1 -- 172.21.15.26:0/1229093207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0035b0 con 0x7ffb5c003be0 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb72ffd700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb5c004850 0x7ffb5c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:20.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb737fe700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb5c003be0 0x7ffb5c003fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb680019b0 tx=0x7ffb5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30bd750f09dc753 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680014a0 con 0x7ffb5c003be0 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb680052d0 con 0x7ffb5c003be0 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb727fc700 1 -- 172.21.15.26:0/1229093207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680036d0 con 0x7ffb5c003be0 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb79b43700 1 -- 172.21.15.26:0/1229093207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb5c003be0 msgr2=0x7ffb5c003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb79b43700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb5c003be0 0x7ffb5c003fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb680019b0 tx=0x7ffb5c005880 comp rx=0 tx=0).stop 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb79b43700 1 -- 172.21.15.26:0/1229093207 shutdown_connections 2023-06-09T04:38:20.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb79b43700 1 --2- 172.21.15.26:0/1229093207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb5c003be0 0x7ffb5c003fd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.195+0000 7ffb79b43700 1 -- 172.21.15.26:0/1229093207 >> 172.21.15.26:0/1229093207 conn(0x7ffb74098a30 msgr2=0x7ffb740cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.196+0000 7ffb79b43700 1 -- 172.21.15.26:0/1229093207 shutdown_connections 2023-06-09T04:38:20.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.196+0000 7ffb79b43700 1 -- 172.21.15.26:0/1229093207 wait complete. 2023-06-09T04:38:20.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.197+0000 7ffb79b43700 1 Processor -- start 2023-06-09T04:38:20.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.197+0000 7ffb79b43700 1 -- start start 2023-06-09T04:38:20.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c003be0 0x7ffb741f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 0x7ffb740b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb740b4840 0x7ffb740b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b5200 con 0x7ffb741f2380 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b3b20 con 0x7ffb740b4840 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b2f10 con 0x7ffb5c003be0 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 0x7ffb740b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 0x7ffb740b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37826/0 (socket says 172.21.15.26:37826) 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 -- 172.21.15.26:0/3994518194 learned_addr learned my addr 172.21.15.26:0/3994518194 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb737fe700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c003be0 0x7ffb741f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb73fff700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb740b4840 0x7ffb740b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 -- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c003be0 msgr2=0x7ffb741f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c003be0 0x7ffb741f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 -- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb740b4840 msgr2=0x7ffb740b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb740b4840 0x7ffb740b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 -- 172.21.15.26:0/3994518194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740b31f0 con 0x7ffb741f2380 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb72ffd700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 0x7ffb740b2610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb64000c00 tx=0x7ffb6400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64010510 con 0x7ffb741f2380 2023-06-09T04:38:20.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64010670 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb740b34d0 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64010a00 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.198+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb741f31e0 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.199+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb74067180 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.200+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb64010b60 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.200+0000 7ffb5bfff700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffb6006ace0 0x7ffb6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.200+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb64088b20 con 0x7ffb741f2380 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.200+0000 7ffb737fe700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffb6006ace0 0x7ffb6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.201+0000 7ffb737fe700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffb6006ace0 0x7ffb6006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b17d0 tx=0x7ffb6800a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.205+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb64053d10 con 0x7ffb741f2380 2023-06-09T04:38:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.461+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ffb740b3c60 con 0x7ffb741f2380 2023-06-09T04:38:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.464+0000 7ffb5bfff700 1 -- 172.21.15.26:0/3994518194 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170841 (secure 0 0 0) 0x7ffb64019020 con 0x7ffb741f2380 2023-06-09T04:38:20.466 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffb6006ace0 msgr2=0x7ffb6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffb6006ace0 0x7ffb6006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b17d0 tx=0x7ffb6800a000 comp rx=0 tx=0).stop 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 msgr2=0x7ffb740b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 0x7ffb740b2610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb64000c00 tx=0x7ffb6400eb10 comp rx=0 tx=0).stop 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 shutdown_connections 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb740b4840 0x7ffb740b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffb5c003be0 0x7ffb741f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffb6006ace0 0x7ffb6006d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 --2- 172.21.15.26:0/3994518194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb741f2380 0x7ffb740b2610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 >> 172.21.15.26:0/3994518194 conn(0x7ffb74098a30 msgr2=0x7ffb74156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 shutdown_connections 2023-06-09T04:38:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.466+0000 7ffb79b43700 1 -- 172.21.15.26:0/3994518194 wait complete. 2023-06-09T04:38:20.479 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":83486613},{"type":"v1","addr":"172.21.15.104:6833","nonce":83486613}]},"active_addr":"172.21.15.104:6833/83486613","active_change":"2023-06-09T04:37:57.862383+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1210289479}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1892224072}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":217004097}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":889457796}]}]} 2023-06-09T04:38:20.483 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-09T04:38:20.484 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-09T04:38:20.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.606+0000 7fe3fe472700 1 Processor -- start 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fe472700 1 -- start start 2023-06-09T04:38:20.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fe472700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe3f80ca540 0x7fe3f80ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fe472700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3f80ceae0 0x7fe3f806da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fe472700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f8159880 con 0x7fe3f80aed90 2023-06-09T04:38:20.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fe472700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80cda30 con 0x7fe3f80ceae0 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fe472700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f806cff0 con 0x7fe3f80ca540 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3fca0f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3f80ceae0 0x7fe3f806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3f7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3f80aed90 0x7fe3f80c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46690/0 (socket says 172.21.15.26:46690) 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.607+0000 7fe3f7fff700 1 -- 172.21.15.26:0/2603671017 learned_addr learned my addr 172.21.15.26:0/2603671017 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3f77fe700 1 --2- 172.21.15.26:0/2603671017 >> v2:172.21.15.104:3300/0 conn(0x7fe3f80ca540 0x7fe3f80ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3fca0f700 1 -- 172.21.15.26:0/2603671017 >> v2:172.21.15.104:3300/0 conn(0x7fe3f80ca540 msgr2=0x7fe3f80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3fca0f700 1 --2- 172.21.15.26:0/2603671017 >> v2:172.21.15.104:3300/0 conn(0x7fe3f80ca540 0x7fe3f80ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3fca0f700 1 -- 172.21.15.26:0/2603671017 >> v1:172.21.15.26:6789/0 conn(0x7fe3f80aed90 legacy=0x7fe3f80c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3fca0f700 1 -- 172.21.15.26:0/2603671017 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80cf250 con 0x7fe3f80ceae0 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2603671017 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110442146 0 0) 0x7fe3f8159880 con 0x7fe3f80aed90 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3f77fe700 1 --2- 172.21.15.26:0/2603671017 >> v2:172.21.15.104:3300/0 conn(0x7fe3f80ca540 0x7fe3f80ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3fca0f700 1 --2- 172.21.15.26:0/2603671017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f806da60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80d0610 tx=0x7fe3f000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9430cec9d0272db server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2603671017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0010070 con 0x7fe3f80ceae0 2023-06-09T04:38:20.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2603671017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000b2e0 con 0x7fe3f80ceae0 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.608+0000 7fe3f6ffd700 1 -- 172.21.15.26:0/2603671017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000dcc0 con 0x7fe3f80ceae0 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 -- 172.21.15.26:0/2603671017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 msgr2=0x7fe3f806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 --2- 172.21.15.26:0/2603671017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f806da60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80d0610 tx=0x7fe3f000d330 comp rx=0 tx=0).stop 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 -- 172.21.15.26:0/2603671017 shutdown_connections 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 --2- 172.21.15.26:0/2603671017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f806da60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 --2- 172.21.15.26:0/2603671017 >> v2:172.21.15.104:3300/0 conn(0x7fe3f80ca540 0x7fe3f80ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 -- 172.21.15.26:0/2603671017 >> 172.21.15.26:0/2603671017 conn(0x7fe3f8098a30 msgr2=0x7fe3f80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 -- 172.21.15.26:0/2603671017 shutdown_connections 2023-06-09T04:38:20.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.609+0000 7fe3fe472700 1 -- 172.21.15.26:0/2603671017 wait complete. 2023-06-09T04:38:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.610+0000 7fe3fe472700 1 Processor -- start 2023-06-09T04:38:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.610+0000 7fe3fe472700 1 -- start start 2023-06-09T04:38:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fe472700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f80aed90 0x7fe3f80b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fe472700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f80ca540 0x7fe3f81ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fe472700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f81e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fe472700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b2610 con 0x7fe3f80ceae0 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fe472700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b28f0 con 0x7fe3f80ca540 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fe472700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b5480 con 0x7fe3f80aed90 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f81e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f81e15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37842/0 (socket says 172.21.15.26:37842) 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 -- 172.21.15.26:0/909113299 learned_addr learned my addr 172.21.15.26:0/909113299 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3f77fe700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f80ca540 0x7fe3f81ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f80aed90 0x7fe3f80b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 -- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f80aed90 msgr2=0x7fe3f80b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f80aed90 0x7fe3f80b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 -- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f80ca540 msgr2=0x7fe3f81ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f80ca540 0x7fe3f81ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 -- 172.21.15.26:0/909113299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f000bc80 con 0x7fe3f80ceae0 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f80aed90 0x7fe3f80b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.611+0000 7fe3fca0f700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f81e15a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80b23d0 tx=0x7fe3f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.612+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004930 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.612+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000b450 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.612+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f8156c10 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.612+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0009760 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.612+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81571d0 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.612+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80b2a60 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.613+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3f00098c0 con 0x7fe3f80ceae0 2023-06-09T04:38:20.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.613+0000 7fe3f4ff9700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d806ace0 0x7fe3d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.614+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3f008cf70 con 0x7fe3f80ceae0 2023-06-09T04:38:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.614+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d806ace0 0x7fe3d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.614+0000 7fe3f7fff700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d806ace0 0x7fe3d806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80010e0 tx=0x7fe3e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.618+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3f00bf310 con 0x7fe3f80ceae0 2023-06-09T04:38:20.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.816+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3f8067180 con 0x7fe3f80ceae0 2023-06-09T04:38:20.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.817+0000 7fe3f4ff9700 1 -- 172.21.15.26:0/909113299 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fe3f00580b0 con 0x7fe3f80ceae0 2023-06-09T04:38:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:20.819 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d806ace0 msgr2=0x7fe3d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d806ace0 0x7fe3d806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80010e0 tx=0x7fe3e8009040 comp rx=0 tx=0).stop 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 msgr2=0x7fe3f81e15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f81e15a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80b23d0 tx=0x7fe3f0004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 shutdown_connections 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d806ace0 0x7fe3d806d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3f80ceae0 0x7fe3f81e15a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f80aed90 0x7fe3f80b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 --2- 172.21.15.26:0/909113299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f80ca540 0x7fe3f81ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 >> 172.21.15.26:0/909113299 conn(0x7fe3f8098a30 msgr2=0x7fe3f8158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 shutdown_connections 2023-06-09T04:38:20.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.819+0000 7fe3fe472700 1 -- 172.21.15.26:0/909113299 wait complete. 2023-06-09T04:38:20.832 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-09T04:38:20.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 Processor -- start 2023-06-09T04:38:20.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 -- start start 2023-06-09T04:38:20.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cc415a340 0x7f6cc40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40b0850 0x7f6cc40ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc40d08b0 con 0x7f6cc40ce4b0 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40cee70 con 0x7f6cc415a340 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.956+0000 7f6cca9bf700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc415a710 con 0x7f6cc40b0850 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc8f5c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40b0850 0x7f6cc40ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc3fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cc415a340 0x7f6cc40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc37fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6cc40ce4b0 0x7f6cc40b0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:45616/0 (socket says 172.21.15.26:45616) 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc37fe700 1 -- 172.21.15.26:0/243887437 learned_addr learned my addr 172.21.15.26:0/243887437 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc3fff700 1 -- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40b0850 msgr2=0x7f6cc40ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc3fff700 1 --2- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40b0850 0x7f6cc40ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc3fff700 1 -- 172.21.15.26:0/243887437 >> v1:172.21.15.104:6789/0 conn(0x7f6cc40ce4b0 legacy=0x7f6cc40b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc3fff700 1 -- 172.21.15.26:0/243887437 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40b0d20 con 0x7f6cc415a340 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc8f5c700 1 --2- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40b0850 0x7f6cc40ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:20.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc3fff700 1 --2- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc40b1dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009820 tx=0x7f6cb8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421f8baec199f65d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc2ffd700 1 -- 172.21.15.26:0/243887437 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8005e30 con 0x7f6cc415a340 2023-06-09T04:38:20.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc2ffd700 1 -- 172.21.15.26:0/243887437 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8006030 con 0x7f6cc415a340 2023-06-09T04:38:20.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.957+0000 7f6cc2ffd700 1 -- 172.21.15.26:0/243887437 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80063c0 con 0x7f6cc415a340 2023-06-09T04:38:20.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 -- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 msgr2=0x7f6cc40b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc40b1dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009820 tx=0x7f6cb8009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:20.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 -- 172.21.15.26:0/243887437 shutdown_connections 2023-06-09T04:38:20.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40b0850 0x7f6cc40ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/243887437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc40b1dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 -- 172.21.15.26:0/243887437 >> 172.21.15.26:0/243887437 conn(0x7f6cc4089fc0 msgr2=0x7f6cc408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 -- 172.21.15.26:0/243887437 shutdown_connections 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.958+0000 7f6cca9bf700 1 -- 172.21.15.26:0/243887437 wait complete. 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.960+0000 7f6cca9bf700 1 Processor -- start 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.960+0000 7f6cca9bf700 1 -- start start 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cca9bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 0x7f6cc40b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cca9bf700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40ce4b0 0x7f6cc4152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cca9bf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc41e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cca9bf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b57e0 con 0x7f6cc40b0850 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cca9bf700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b4f20 con 0x7f6cc415a340 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cca9bf700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b5190 con 0x7f6cc40ce4b0 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 0x7f6cc40b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 0x7f6cc40b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37850/0 (socket says 172.21.15.26:37850) 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 -- 172.21.15.26:0/4085577384 learned_addr learned my addr 172.21.15.26:0/4085577384 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc8f5c700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc41e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc37fe700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40ce4b0 0x7f6cc4152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 -- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40ce4b0 msgr2=0x7f6cc4152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40ce4b0 0x7f6cc4152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 -- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 msgr2=0x7f6cc41e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc41e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 -- 172.21.15.26:0/4085577384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc009a70 con 0x7f6cc40b0850 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc37fe700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40ce4b0 0x7f6cc4152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:20.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.961+0000 7f6cc3fff700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 0x7f6cc40b5c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cc406de40 tx=0x7f6cb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.962+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80063a0 con 0x7f6cc40b0850 2023-06-09T04:38:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.962+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8020070 con 0x7f6cc40b0850 2023-06-09T04:38:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.962+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb8009430 con 0x7f6cc40b0850 2023-06-09T04:38:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.962+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8006740 con 0x7f6cc40b0850 2023-06-09T04:38:20.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.962+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc41f0a40 con 0x7f6cc40b0850 2023-06-09T04:38:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.963+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc4159130 con 0x7f6cc40b0850 2023-06-09T04:38:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.963+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6cb8022030 con 0x7f6cc40b0850 2023-06-09T04:38:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.963+0000 7f6cc0ff9700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6cb006ace0 0x7f6cb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.963+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6cb808aa90 con 0x7f6cc40b0850 2023-06-09T04:38:20.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.964+0000 7f6cc37fe700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6cb006ace0 0x7f6cb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.964+0000 7f6cc37fe700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6cb006ace0 0x7f6cb006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4005910 tx=0x7f6cb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:20.968+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6cb8055c70 con 0x7f6cc40b0850 2023-06-09T04:38:21.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.165+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cc4158e50 con 0x7f6cc40b0850 2023-06-09T04:38:21.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.166+0000 7f6cc0ff9700 1 -- 172.21.15.26:0/4085577384 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f6cb80068a0 con 0x7f6cc40b0850 2023-06-09T04:38:21.167 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:21.168 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6cb006ace0 msgr2=0x7f6cb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6cb006ace0 0x7f6cb006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4005910 tx=0x7f6cb4009040 comp rx=0 tx=0).stop 2023-06-09T04:38:21.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 msgr2=0x7f6cc40b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 0x7f6cc40b5c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cc406de40 tx=0x7f6cb8004750 comp rx=0 tx=0).stop 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 shutdown_connections 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc415a340 0x7f6cc41e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6cb006ace0 0x7f6cb006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cc40b0850 0x7f6cc40b5c70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 --2- 172.21.15.26:0/4085577384 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6cc40ce4b0 0x7f6cc4152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 >> 172.21.15.26:0/4085577384 conn(0x7f6cc4089fc0 msgr2=0x7f6cc41578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 shutdown_connections 2023-06-09T04:38:21.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.168+0000 7f6cca9bf700 1 -- 172.21.15.26:0/4085577384 wait complete. 2023-06-09T04:38:21.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-09T04:38:21.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-09T04:38:21.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-09T04:38:21.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-09T04:38:21.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-09T04:38:21.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-09T04:38:21.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-09T04:38:21.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-09T04:38:21.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7fc836162700 1 Processor -- start 2023-06-09T04:38:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.406+0000 7f0703c14700 1 Processor -- start 2023-06-09T04:38:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 -- start start 2023-06-09T04:38:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06fc16cd50 0x7f06fc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f06fc0cc2e0 0x7f06fc0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc06d5a0 con 0x7f06fc16cd50 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0ccc50 con 0x7f06fc0cc2e0 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0703c14700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0adea0 con 0x7f06fc089b80 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f07011af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06fc16cd50 0x7f06fc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f07011af700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06fc16cd50 0x7f06fc06da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37860/0 (socket says 172.21.15.26:37860) 2023-06-09T04:38:21.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7fb298722700 1 Processor -- start 2023-06-09T04:38:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0e9491a700 1 Processor -- start 2023-06-09T04:38:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.407+0000 7f0e9491a700 1 -- start start 2023-06-09T04:38:21.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f63a6e40700 1 Processor -- start 2023-06-09T04:38:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f63a6e40700 1 -- start start 2023-06-09T04:38:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7fc836162700 1 -- start start 2023-06-09T04:38:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc836162700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc8300cebc0 0x7fc8300b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc836162700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc836162700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8300b0ac0 con 0x7fc83015a340 2023-06-09T04:38:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc836162700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83015a710 con 0x7fc8300cebc0 2023-06-09T04:38:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc836162700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300d08b0 con 0x7fc8300b0140 2023-06-09T04:38:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc82f7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc83015a340 0x7fc8300ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:45640/0 (socket says 172.21.15.26:45640) 2023-06-09T04:38:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fc82f7fe700 1 -- 172.21.15.26:0/2302662158 learned_addr learned my addr 172.21.15.26:0/2302662158 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:21.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e9491a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0e9006de50 0x7f0e900cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e9491a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e90169670 con 0x7f0e900b0190 2023-06-09T04:38:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e9491a700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9006cdb0 con 0x7f0e900b0d30 2023-06-09T04:38:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e9491a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e90089e80 con 0x7f0e9006de50 2023-06-09T04:38:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e8e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0e900b0190 0x7f0e900b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46722/0 (socket says 172.21.15.26:46722) 2023-06-09T04:38:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e8e59c700 1 -- 172.21.15.26:0/1828228114 learned_addr learned my addr 172.21.15.26:0/1828228114 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:21.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f0e87fff700 1 --2- 172.21.15.26:0/1828228114 >> v2:172.21.15.104:3300/0 conn(0x7f0e9006de50 0x7f0e900cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a6e40700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f63a0158900 0x7f63a015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a6e40700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f07021b1700 1 --2- 172.21.15.26:0/174922398 >> v2:172.21.15.104:3300/0 conn(0x7f06fc0cc2e0 0x7f06fc0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f07019b0700 1 --2- 172.21.15.26:0/174922398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82ffff700 1 --2- 172.21.15.26:0/2302662158 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82e7fc700 1 -- 172.21.15.26:0/2302662158 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845152132 0 0) 0x7fc8300b0ac0 con 0x7fc83015a340 2023-06-09T04:38:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82e7fc700 1 -- 172.21.15.26:0/2302662158 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8180035b0 con 0x7fc83015a340 2023-06-09T04:38:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e87fff700 1 -- 172.21.15.26:0/1828228114 >> v1:172.21.15.104:6789/0 conn(0x7f0e900b0d30 legacy=0x7f0e900cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e87fff700 1 -- 172.21.15.26:0/1828228114 >> v1:172.21.15.26:6789/0 conn(0x7f0e900b0190 legacy=0x7f0e900b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e87fff700 1 -- 172.21.15.26:0/1828228114 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9006d090 con 0x7f0e9006de50 2023-06-09T04:38:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e8dd9b700 1 -- 172.21.15.26:0/1828228114 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412655735 0 0) 0x7f0e9006cdb0 con 0x7f0e900b0d30 2023-06-09T04:38:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a6e40700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a00b1170 con 0x7f63a006a890 2023-06-09T04:38:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a6e40700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00ccd80 con 0x7f63a0158900 2023-06-09T04:38:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a6e40700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a015c380 con 0x7f63a00cc630 2023-06-09T04:38:21.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f63a0158900 0x7f63a015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f63a0158900 0x7f63a015ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:44996/0 (socket says 172.21.15.26:44996) 2023-06-09T04:38:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.408+0000 7f07011af700 1 -- 172.21.15.26:0/174922398 learned_addr learned my addr 172.21.15.26:0/174922398 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f07011af700 1 -- 172.21.15.26:0/174922398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 msgr2=0x7f06fc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f07011af700 1 --2- 172.21.15.26:0/174922398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc06c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 -- 172.21.15.26:0/3437356372 learned_addr learned my addr 172.21.15.26:0/3437356372 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f639ffff700 1 --2- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f07011af700 1 -- 172.21.15.26:0/174922398 >> v2:172.21.15.104:3300/0 conn(0x7f06fc0cc2e0 msgr2=0x7f06fc0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f07011af700 1 --2- 172.21.15.26:0/174922398 >> v2:172.21.15.104:3300/0 conn(0x7f06fc0cc2e0 0x7f06fc0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f07011af700 1 -- 172.21.15.26:0/174922398 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc169620 con 0x7f06fc16cd50 2023-06-09T04:38:21.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7f07011af700 1 --2- 172.21.15.26:0/174922398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc16cd50 0x7f06fc06da30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0716c0 tx=0x7f06f8009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceb6516b0c71180 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.409+0000 7fb298722700 1 -- start start 2023-06-09T04:38:21.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb298722700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb29006ea70 0x7fb290163f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb298722700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb290159880 con 0x7fb2900aed90 2023-06-09T04:38:21.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb298722700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29006cff0 con 0x7fb2900ca540 2023-06-09T04:38:21.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb298722700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900cda30 con 0x7fb29006ea70 2023-06-09T04:38:21.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82effd700 1 --2- 172.21.15.26:0/2302662158 >> v2:172.21.15.26:3300/0 conn(0x7fc8300cebc0 0x7fc8300b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e87fff700 1 --2- 172.21.15.26:0/1828228114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e900cc730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e78008840 tx=0x7f0e7800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=937d9890e762afbf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 -- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 msgr2=0x7f63a00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 --2- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 -- 172.21.15.26:0/3437356372 >> v1:172.21.15.104:6789/0 conn(0x7f63a006a890 legacy=0x7f63a00c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f63a4bdc700 1 -- 172.21.15.26:0/3437356372 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a015c660 con 0x7f63a0158900 2023-06-09T04:38:21.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb295cbd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb2900ca540 0x7fb2900ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:45652/0 (socket says 172.21.15.26:45652) 2023-06-09T04:38:21.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb295cbd700 1 -- 172.21.15.26:0/4103891017 learned_addr learned my addr 172.21.15.26:0/4103891017 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:21.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fb296cbf700 1 --2- 172.21.15.26:0/4103891017 >> v2:172.21.15.104:3300/0 conn(0x7fb29006ea70 0x7fb290163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e8dd9b700 1 -- 172.21.15.26:0/1828228114 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78010070 con 0x7f0e9006de50 2023-06-09T04:38:21.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e8dd9b700 1 -- 172.21.15.26:0/1828228114 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800dbd0 con 0x7f0e9006de50 2023-06-09T04:38:21.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f0e8dd9b700 1 -- 172.21.15.26:0/1828228114 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78008990 con 0x7f0e9006de50 2023-06-09T04:38:21.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82ffff700 1 -- 172.21.15.26:0/2302662158 >> v2:172.21.15.26:3300/0 conn(0x7fc8300cebc0 msgr2=0x7fc8300b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82ffff700 1 --2- 172.21.15.26:0/2302662158 >> v2:172.21.15.26:3300/0 conn(0x7fc8300cebc0 0x7fc8300b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82ffff700 1 -- 172.21.15.26:0/2302662158 >> v1:172.21.15.104:6789/0 conn(0x7fc83015a340 legacy=0x7fc8300ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82e7fc700 1 -- 172.21.15.26:0/2302662158 <== mon.1 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233845150 0 0) 0x7fc8180035b0 con 0x7fc83015a340 2023-06-09T04:38:21.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82ffff700 1 -- 172.21.15.26:0/2302662158 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300b0d20 con 0x7fc8300b0140 2023-06-09T04:38:21.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7fc82effd700 1 --2- 172.21.15.26:0/2302662158 >> v2:172.21.15.26:3300/0 conn(0x7fc8300cebc0 0x7fc8300b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:21.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f63a4bdc700 1 --2- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a0158900 0x7f63a015ce60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f639800f370 tx=0x7f639800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a23c415dbb05a03 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fc82ffff700 1 --2- 172.21.15.26:0/2302662158 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300b0580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc828009d90 tx=0x7fc82800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3597fdd0c4d20bb0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fb296cbf700 1 -- 172.21.15.26:0/4103891017 >> v1:172.21.15.104:6789/0 conn(0x7fb2900ca540 legacy=0x7fb2900ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fb296cbf700 1 -- 172.21.15.26:0/4103891017 >> v1:172.21.15.26:6789/0 conn(0x7fb2900aed90 legacy=0x7fb2900c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fb296cbf700 1 -- 172.21.15.26:0/4103891017 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900cf250 con 0x7fb29006ea70 2023-06-09T04:38:21.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fc82e7fc700 1 -- 172.21.15.26:0/2302662158 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200016c0 con 0x7fc8300b0140 2023-06-09T04:38:21.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fc82e7fc700 1 -- 172.21.15.26:0/2302662158 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828003a20 con 0x7fc8300b0140 2023-06-09T04:38:21.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fc82e7fc700 1 -- 172.21.15.26:0/2302662158 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828003dd0 con 0x7fc8300b0140 2023-06-09T04:38:21.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fb296cbf700 1 --2- 172.21.15.26:0/4103891017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb29006ea70 0x7fb290163f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb288009d90 tx=0x7fb28800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b9acab7d07b2f91 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f07009ae700 1 -- 172.21.15.26:0/174922398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f801b410 con 0x7f06fc16cd50 2023-06-09T04:38:21.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f07009ae700 1 -- 172.21.15.26:0/174922398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f801b570 con 0x7f06fc16cd50 2023-06-09T04:38:21.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.410+0000 7f07009ae700 1 -- 172.21.15.26:0/174922398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f801b8e0 con 0x7f06fc16cd50 2023-06-09T04:38:21.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 -- 172.21.15.26:0/174922398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc16cd50 msgr2=0x7f06fc06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 --2- 172.21.15.26:0/174922398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc16cd50 0x7f06fc06da30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0716c0 tx=0x7f06f8009710 comp rx=0 tx=0).stop 2023-06-09T04:38:21.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0e9491a700 1 -- 172.21.15.26:0/1828228114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 msgr2=0x7f0e900cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0e9491a700 1 --2- 172.21.15.26:0/1828228114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e900cc730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e78008840 tx=0x7f0e7800d330 comp rx=0 tx=0).stop 2023-06-09T04:38:21.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 -- 172.21.15.26:0/174922398 shutdown_connections 2023-06-09T04:38:21.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 --2- 172.21.15.26:0/174922398 >> v2:172.21.15.104:3300/0 conn(0x7f06fc0cc2e0 0x7f06fc0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 --2- 172.21.15.26:0/174922398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc06c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 --2- 172.21.15.26:0/174922398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc16cd50 0x7f06fc06da30 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0716c0 tx=0x7f06f8009710 comp rx=0 tx=0).stop 2023-06-09T04:38:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0703c14700 1 -- 172.21.15.26:0/174922398 >> 172.21.15.26:0/174922398 conn(0x7f06fc069db0 msgr2=0x7f06fc06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7f0e9491a700 1 -- 172.21.15.26:0/1828228114 shutdown_connections 2023-06-09T04:38:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f0e9491a700 1 --2- 172.21.15.26:0/1828228114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e900cc730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f0e9491a700 1 -- 172.21.15.26:0/1828228114 >> 172.21.15.26:0/1828228114 conn(0x7f0e90069db0 msgr2=0x7f0e9006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f639f7fe700 1 -- 172.21.15.26:0/3437356372 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398012070 con 0x7f63a0158900 2023-06-09T04:38:21.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f639f7fe700 1 -- 172.21.15.26:0/3437356372 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639800fe30 con 0x7f63a0158900 2023-06-09T04:38:21.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f639f7fe700 1 -- 172.21.15.26:0/3437356372 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398003c60 con 0x7f63a0158900 2023-06-09T04:38:21.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fc836162700 1 -- 172.21.15.26:0/2302662158 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 msgr2=0x7fc8300b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fc836162700 1 --2- 172.21.15.26:0/2302662158 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300b0580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc828009d90 tx=0x7fc82800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f0e9491a700 1 -- 172.21.15.26:0/1828228114 shutdown_connections 2023-06-09T04:38:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f4c13d17700 1 Processor -- start 2023-06-09T04:38:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7f4c13d17700 1 -- start start 2023-06-09T04:38:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.411+0000 7fb2954bc700 1 -- 172.21.15.26:0/4103891017 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800e070 con 0x7fb29006ea70 2023-06-09T04:38:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fb2954bc700 1 -- 172.21.15.26:0/4103891017 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800bad0 con 0x7fb29006ea70 2023-06-09T04:38:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fb2954bc700 1 -- 172.21.15.26:0/4103891017 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800be60 con 0x7fb29006ea70 2023-06-09T04:38:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fb298722700 1 -- 172.21.15.26:0/4103891017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb29006ea70 msgr2=0x7fb290163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fb298722700 1 --2- 172.21.15.26:0/4103891017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb29006ea70 0x7fb290163f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb288009d90 tx=0x7fb28800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.412+0000 7fdbc63e1700 1 Processor -- start 2023-06-09T04:38:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fdbc63e1700 1 -- start start 2023-06-09T04:38:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fc836162700 1 -- 172.21.15.26:0/2302662158 shutdown_connections 2023-06-09T04:38:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fc836162700 1 --2- 172.21.15.26:0/2302662158 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300b0580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fc836162700 1 --2- 172.21.15.26:0/2302662158 >> v2:172.21.15.26:3300/0 conn(0x7fc8300cebc0 0x7fc8300b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fc836162700 1 -- 172.21.15.26:0/2302662158 >> 172.21.15.26:0/2302662158 conn(0x7fc830089fc0 msgr2=0x7fc83008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f63a6e40700 1 -- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a0158900 msgr2=0x7f63a015ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f63a6e40700 1 --2- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a0158900 0x7f63a015ce60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f639800f370 tx=0x7f639800f680 comp rx=0 tx=0).stop 2023-06-09T04:38:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fb298722700 1 -- 172.21.15.26:0/4103891017 shutdown_connections 2023-06-09T04:38:21.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fb298722700 1 --2- 172.21.15.26:0/4103891017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb29006ea70 0x7fb290163f90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fb298722700 1 -- 172.21.15.26:0/4103891017 >> 172.21.15.26:0/4103891017 conn(0x7fb290098a30 msgr2=0x7fb2900cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fc836162700 1 -- 172.21.15.26:0/2302662158 shutdown_connections 2023-06-09T04:38:21.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fc836162700 1 -- 172.21.15.26:0/2302662158 wait complete. 2023-06-09T04:38:21.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f63a6e40700 1 -- 172.21.15.26:0/3437356372 shutdown_connections 2023-06-09T04:38:21.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f63a6e40700 1 --2- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a0158900 0x7f63a015ce60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f63a6e40700 1 --2- 172.21.15.26:0/3437356372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f63a6e40700 1 -- 172.21.15.26:0/3437356372 >> 172.21.15.26:0/3437356372 conn(0x7f63a0069db0 msgr2=0x7f63a006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f318bc04700 1 Processor -- start 2023-06-09T04:38:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f0e9491a700 1 -- 172.21.15.26:0/1828228114 wait complete. 2023-06-09T04:38:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fb298722700 1 -- 172.21.15.26:0/4103891017 shutdown_connections 2023-06-09T04:38:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7fb298722700 1 -- 172.21.15.26:0/4103891017 wait complete. 2023-06-09T04:38:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f318bc04700 1 -- start start 2023-06-09T04:38:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f4c13d17700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 0x7f4c0c164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f4c13d17700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4c0c0c1a70 0x7f4c0c1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f4c13d17700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4c0c0cb370 0x7f4c0c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f4c13d17700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c0cbd00 con 0x7f4c0c0cb370 2023-06-09T04:38:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f4c13d17700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c164ba0 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.413+0000 7f4c13d17700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c164e00 con 0x7f4c0c0cc8f0 2023-06-09T04:38:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f0703c14700 1 -- 172.21.15.26:0/174922398 shutdown_connections 2023-06-09T04:38:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc63e1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00ae360 0x7fdbc0065a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc63e1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdbc00710d0 0x7fdbc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc63e1700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc0159030 con 0x7fdbc006dc40 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc63e1700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc006e190 con 0x7fdbc00710d0 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc63e1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01592d0 con 0x7fdbc00ae360 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc497e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdbc00710d0 0x7fdbc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc497e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdbc00710d0 0x7fdbc0069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45014/0 (socket says 172.21.15.26:45014) 2023-06-09T04:38:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7fdbc497e700 1 -- 172.21.15.26:0/226146980 learned_addr learned my addr 172.21.15.26:0/226146980 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fdbc497e700 1 -- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00ae360 msgr2=0x7fdbc0065a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fdbc497e700 1 --2- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00ae360 0x7fdbc0065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fdbc497e700 1 -- 172.21.15.26:0/226146980 >> v1:172.21.15.104:6789/0 conn(0x7fdbc006dc40 legacy=0x7fdbc00709c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:38:21.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fdbc497e700 1 -- 172.21.15.26:0/226146980 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc01595b0 con 0x7fdbc00710d0 2023-06-09T04:38:21.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fc836162700 1 Processor -- start 2023-06-09T04:38:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318bc04700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3184159080 0x7f31840c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318bc04700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31840ae760 0x7f31840ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318bc04700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31840cd7a0 con 0x7f31840aecd0 2023-06-09T04:38:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318bc04700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3184099030 con 0x7f31840ae760 2023-06-09T04:38:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318bc04700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31840cca60 con 0x7f3184159080 2023-06-09T04:38:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f0e9491a700 1 Processor -- start 2023-06-09T04:38:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fdbc497e700 1 --2- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc00710d0 0x7fdbc0069db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009e50 tx=0x7fdbb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1dcc94104d1c722 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31840ae760 0x7f31840ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31840ae760 0x7f31840ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37898/0 (socket says 172.21.15.26:37898) 2023-06-09T04:38:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 -- 172.21.15.26:0/437409836 learned_addr learned my addr 172.21.15.26:0/437409836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fb298722700 1 Processor -- start 2023-06-09T04:38:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f31899a0700 1 --2- 172.21.15.26:0/437409836 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3184159080 0x7f31840c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 -- 172.21.15.26:0/437409836 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3184159080 msgr2=0x7f31840c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 --2- 172.21.15.26:0/437409836 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3184159080 0x7f31840c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 -- 172.21.15.26:0/437409836 >> v1:172.21.15.26:6789/0 conn(0x7f31840aecd0 legacy=0x7f318415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f318919f700 1 -- 172.21.15.26:0/437409836 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840ccd40 con 0x7f31840ae760 2023-06-09T04:38:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 0x7f4c0c164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 0x7f4c0c164660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48546/0 (socket says 172.21.15.26:48546) 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 -- 172.21.15.26:0/86744697 learned_addr learned my addr 172.21.15.26:0/86744697 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 -- 172.21.15.26:0/86744697 >> v2:172.21.15.104:3300/0 conn(0x7f4c0c0c1a70 msgr2=0x7f4c0c1618e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 --2- 172.21.15.26:0/86744697 >> v2:172.21.15.104:3300/0 conn(0x7f4c0c0c1a70 0x7f4c0c1618e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 -- 172.21.15.26:0/86744697 >> v2:172.21.15.26:3300/0 conn(0x7f4c0c0cb370 msgr2=0x7f4c0c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 --2- 172.21.15.26:0/86744697 >> v2:172.21.15.26:3300/0 conn(0x7f4c0c0cb370 0x7f4c0c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f4c11ab3700 1 -- 172.21.15.26:0/86744697 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c1650e0 con 0x7f4c0c0cc8f0 2023-06-09T04:38:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f4c11ab3700 1 --2- 172.21.15.26:0/86744697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 0x7f4c0c164660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0b1290 tx=0x7f4c0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac574c207d6d971 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f4c10ab1700 1 -- 172.21.15.26:0/86744697 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0400e070 con 0x7f4c0c0cc8f0 2023-06-09T04:38:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f4c10ab1700 1 -- 172.21.15.26:0/86744697 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0400b9c0 con 0x7f4c0c0cc8f0 2023-06-09T04:38:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7f4c10ab1700 1 -- 172.21.15.26:0/86744697 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0400bd70 con 0x7f4c0c0cc8f0 2023-06-09T04:38:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.414+0000 7f0703c14700 1 -- 172.21.15.26:0/174922398 wait complete. 2023-06-09T04:38:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f0703c14700 1 Processor -- start 2023-06-09T04:38:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f318919f700 1 --2- 172.21.15.26:0/437409836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31840ae760 0x7f31840ca350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f318000bb90 tx=0x7f318000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508bcff653d699f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f4c13d17700 1 -- 172.21.15.26:0/86744697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 msgr2=0x7f4c0c164660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f4c13d17700 1 --2- 172.21.15.26:0/86744697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 0x7f4c0c164660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0b1290 tx=0x7f4c0400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fdbbeffd700 1 -- 172.21.15.26:0/226146980 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800e070 con 0x7fdbc00710d0 2023-06-09T04:38:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fdbbeffd700 1 -- 172.21.15.26:0/226146980 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8003a20 con 0x7fdbc00710d0 2023-06-09T04:38:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fdbbeffd700 1 -- 172.21.15.26:0/226146980 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8003db0 con 0x7fdbc00710d0 2023-06-09T04:38:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fc836162700 1 -- start start 2023-06-09T04:38:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f63a6e40700 1 -- 172.21.15.26:0/3437356372 shutdown_connections 2023-06-09T04:38:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc836162700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc836162700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8300cebc0 0x7fc8300c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc836162700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc83015a340 0x7fc8300b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc836162700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300c4260 con 0x7fc8300cebc0 2023-06-09T04:38:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc836162700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301e2ef0 con 0x7fc83015a340 2023-06-09T04:38:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc836162700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301e31d0 con 0x7fc8300b0140 2023-06-09T04:38:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f63a6e40700 1 -- 172.21.15.26:0/3437356372 wait complete. 2023-06-09T04:38:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc82f7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc82f7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48564/0 (socket says 172.21.15.26:48564) 2023-06-09T04:38:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fc82f7fe700 1 -- 172.21.15.26:0/2627287332 learned_addr learned my addr 172.21.15.26:0/2627287332 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0e9491a700 1 -- start start 2023-06-09T04:38:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fc82f7fe700 1 -- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc83015a340 msgr2=0x7fc8300b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fc82f7fe700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc83015a340 0x7fc8300b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fc82f7fe700 1 -- 172.21.15.26:0/2627287332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8300cebc0 msgr2=0x7fc8300c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fc82f7fe700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8300cebc0 0x7fc8300c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fc82f7fe700 1 -- 172.21.15.26:0/2627287332 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009a70 con 0x7fc8300b0140 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f0703c14700 1 -- start start 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0703c14700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0703c14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc0cc2e0 0x7f06fc088920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0703c14700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06fc0c4690 0x7f06fc0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0703c14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b0120 con 0x7f06fc0cc2e0 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0703c14700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0af510 con 0x7f06fc0c4690 2023-06-09T04:38:21.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f0703c14700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0af7f0 con 0x7f06fc089b80 2023-06-09T04:38:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f07019b0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f07019b0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc0c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48574/0 (socket says 172.21.15.26:48574) 2023-06-09T04:38:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f07019b0700 1 -- 172.21.15.26:0/2457392418 learned_addr learned my addr 172.21.15.26:0/2457392418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f07021b1700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06fc0c4690 0x7f06fc0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f07011af700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc0cc2e0 0x7f06fc088920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f318899e700 1 -- 172.21.15.26:0/437409836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000dd10 con 0x7f31840ae760 2023-06-09T04:38:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f318899e700 1 -- 172.21.15.26:0/437409836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000de70 con 0x7f31840ae760 2023-06-09T04:38:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7f318899e700 1 -- 172.21.15.26:0/437409836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180004230 con 0x7f31840ae760 2023-06-09T04:38:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f318bc04700 1 -- 172.21.15.26:0/437409836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31840ae760 msgr2=0x7f31840ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7f318bc04700 1 --2- 172.21.15.26:0/437409836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31840ae760 0x7f31840ca350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f318000bb90 tx=0x7f318000bea0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f07019b0700 1 -- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06fc0c4690 msgr2=0x7f06fc0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f07019b0700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06fc0c4690 0x7f06fc0b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f07019b0700 1 -- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc0cc2e0 msgr2=0x7f06fc088920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f07019b0700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06fc0cc2e0 0x7f06fc088920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f07019b0700 1 -- 172.21.15.26:0/2457392418 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f8013a10 con 0x7f06fc089b80 2023-06-09T04:38:21.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f07019b0700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc0c57e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06f400df20 tx=0x7f06f400c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 -- 172.21.15.26:0/86744697 shutdown_connections 2023-06-09T04:38:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 --2- 172.21.15.26:0/86744697 >> v2:172.21.15.26:3300/0 conn(0x7f4c0c0cb370 0x7f4c0c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 --2- 172.21.15.26:0/86744697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0cc8f0 0x7f4c0c164660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 --2- 172.21.15.26:0/86744697 >> v2:172.21.15.104:3300/0 conn(0x7f4c0c0c1a70 0x7f4c0c1618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 -- 172.21.15.26:0/86744697 >> 172.21.15.26:0/86744697 conn(0x7f4c0c069db0 msgr2=0x7f4c0c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4019480 con 0x7f06fc089b80 2023-06-09T04:38:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f4012070 con 0x7f06fc089b80 2023-06-09T04:38:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4019820 con 0x7f06fc089b80 2023-06-09T04:38:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.415+0000 7fb298722700 1 -- start start 2023-06-09T04:38:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb298722700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb29006ea70 0x7fb2900b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb298722700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2900aed90 0x7fb2901df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb298722700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb2900ca540 0x7fb2900c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb298722700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900b3020 con 0x7fb29006ea70 2023-06-09T04:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb298722700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900b4810 con 0x7fb2900aed90 2023-06-09T04:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e9491a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e9020b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e9491a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e900b0190 0x7f0e900c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e9491a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e900b0d30 0x7f0e900c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e9491a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900c5d20 con 0x7f0e900b0d30 2023-06-09T04:38:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e9491a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e901fb440 con 0x7f0e9006de50 2023-06-09T04:38:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e9491a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900c7810 con 0x7f0e900b0190 2023-06-09T04:38:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 -- 172.21.15.26:0/86744697 shutdown_connections 2023-06-09T04:38:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f63a6e40700 1 Processor -- start 2023-06-09T04:38:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb298722700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb290158f10 con 0x7fb2900ca540 2023-06-09T04:38:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.416+0000 7fb2964be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb29006ea70 0x7fb2900b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb29006ea70 0x7fb2900b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37908/0 (socket says 172.21.15.26:37908) 2023-06-09T04:38:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 -- 172.21.15.26:0/3907363142 learned_addr learned my addr 172.21.15.26:0/3907363142 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 -- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb2900ca540 msgr2=0x7fb2900c8620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb2900ca540 0x7fb2900c8620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 -- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2900aed90 msgr2=0x7fb2901df990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2900aed90 0x7fb2901df990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 -- 172.21.15.26:0/3907363142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288009a70 con 0x7fb29006ea70 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.417+0000 7fb2964be700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb29006ea70 0x7fb2900b42d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb28000c450 tx=0x7fb28000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800054e0 con 0x7fb29006ea70 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2900b3230 con 0x7fb29006ea70 2023-06-09T04:38:21.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280003680 con 0x7fb29006ea70 2023-06-09T04:38:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2900b37f0 con 0x7fb29006ea70 2023-06-09T04:38:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280003a30 con 0x7fb29006ea70 2023-06-09T04:38:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e900b0190 0x7f0e900c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e900b0190 0x7f0e900c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48582/0 (socket says 172.21.15.26:48582) 2023-06-09T04:38:21.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e87fff700 1 -- 172.21.15.26:0/1842910287 learned_addr learned my addr 172.21.15.26:0/1842910287 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e9020b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f63a6e40700 1 -- start start 2023-06-09T04:38:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7fdbc63e1700 1 -- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc00710d0 msgr2=0x7fdbc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7fdbc63e1700 1 --2- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc00710d0 0x7fdbc0069db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009e50 tx=0x7fdbb800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f318bc04700 1 -- 172.21.15.26:0/437409836 shutdown_connections 2023-06-09T04:38:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f318bc04700 1 --2- 172.21.15.26:0/437409836 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3184159080 0x7f31840c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f318bc04700 1 --2- 172.21.15.26:0/437409836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31840ae760 0x7f31840ca350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f318bc04700 1 -- 172.21.15.26:0/437409836 >> 172.21.15.26:0/437409836 conn(0x7f3184098b50 msgr2=0x7f31840cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7fdbc63e1700 1 -- 172.21.15.26:0/226146980 shutdown_connections 2023-06-09T04:38:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7fdbc63e1700 1 --2- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc00710d0 0x7fdbc0069db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7fdbc63e1700 1 --2- 172.21.15.26:0/226146980 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00ae360 0x7fdbc0065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7fdbc63e1700 1 -- 172.21.15.26:0/226146980 >> 172.21.15.26:0/226146980 conn(0x7fdbc00cb9d0 msgr2=0x7fdbc00cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e900b0d30 0x7f0e900c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8e59c700 1 -- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e900b0190 msgr2=0x7f0e900c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e900b0190 0x7f0e900c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8e59c700 1 -- 172.21.15.26:0/1842910287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e900b0d30 msgr2=0x7f0e900c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e900b0d30 0x7f0e900c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8e59c700 1 -- 172.21.15.26:0/1842910287 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78008520 con 0x7f0e9006de50 2023-06-09T04:38:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e87fff700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e900b0190 0x7f0e900c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:21.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f318bc04700 1 -- 172.21.15.26:0/437409836 shutdown_connections 2023-06-09T04:38:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f318bc04700 1 -- 172.21.15.26:0/437409836 wait complete. 2023-06-09T04:38:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e8e59c700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e9020b700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000c500 tx=0x7f0e8000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80005d70 con 0x7f0e9006de50 2023-06-09T04:38:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800070d0 con 0x7f0e9006de50 2023-06-09T04:38:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80007440 con 0x7f0e9006de50 2023-06-09T04:38:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.419+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e901fb690 con 0x7f0e9006de50 2023-06-09T04:38:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e901fbc50 con 0x7f0e9006de50 2023-06-09T04:38:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.418+0000 7f4c13d17700 1 -- 172.21.15.26:0/86744697 wait complete. 2023-06-09T04:38:21.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f4c13d17700 1 Processor -- start 2023-06-09T04:38:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7fdbc63e1700 1 -- 172.21.15.26:0/226146980 shutdown_connections 2023-06-09T04:38:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a6e40700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a006a890 0x7f63a00c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a6e40700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a6e40700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a0158900 0x7f63a00c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a6e40700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c6770 con 0x7f63a0158900 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a6e40700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c6a50 con 0x7f63a006a890 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a6e40700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c6d30 con 0x7f63a00cc630 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a4bdc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a006a890 0x7f63a00c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a4bdc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a006a890 0x7f63a00c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45048/0 (socket says 172.21.15.26:45048) 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a4bdc700 1 -- 172.21.15.26:0/2112875430 learned_addr learned my addr 172.21.15.26:0/2112875430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f639ffff700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc0afad0 con 0x7f06fc089b80 2023-06-09T04:38:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc088e60 con 0x7f06fc089b80 2023-06-09T04:38:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a4bdc700 1 -- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 msgr2=0x7f63a00c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a4bdc700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f63a00cc630 0x7f63a00c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a4bdc700 1 -- 172.21.15.26:0/2112875430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a0158900 msgr2=0x7f63a00c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7fc82f7fe700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300c3d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c730 tx=0x7fc82000caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb280003b90 con 0x7fb29006ea70 2023-06-09T04:38:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820004c80 con 0x7fc8300b0140 2023-06-09T04:38:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7f318bc04700 1 Processor -- start 2023-06-09T04:38:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820004de0 con 0x7fc8300b0140 2023-06-09T04:38:21.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200072f0 con 0x7fc8300b0140 2023-06-09T04:38:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7fb286ffd700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb27406ace0 0x7fb27406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f4c13d17700 1 -- start start 2023-06-09T04:38:21.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2800888b0 con 0x7fb29006ea70 2023-06-09T04:38:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8301e34b0 con 0x7fc8300b0140 2023-06-09T04:38:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06fc06cc70 con 0x7f06fc089b80 2023-06-09T04:38:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7fdbc63e1700 1 -- 172.21.15.26:0/226146980 wait complete. 2023-06-09T04:38:21.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7fdbc63e1700 1 Processor -- start 2023-06-09T04:38:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7f318bc04700 1 -- start start 2023-06-09T04:38:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f318bc04700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31840ae760 0x7f31840b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f318bc04700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31840aecd0 0x7f31841eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f318bc04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3184159080 0x7f31841ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f318bc04700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841f0e30 con 0x7f3184159080 2023-06-09T04:38:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f318bc04700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841f1010 con 0x7f31840aecd0 2023-06-09T04:38:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f318bc04700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31840c8060 con 0x7f31840ae760 2023-06-09T04:38:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7f31899a0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31840ae760 0x7f31840b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7fb298722700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] conn(0x7fb2780015e0 0x7fb278003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 --> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb278006bc0 con 0x7fb2780015e0 2023-06-09T04:38:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8301e3a70 con 0x7fc8300b0140 2023-06-09T04:38:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e9006d650 con 0x7f0e9006de50 2023-06-09T04:38:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e800075a0 con 0x7f0e9006de50 2023-06-09T04:38:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.421+0000 7f4c13d17700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0c1a70 0x7f4c0c1f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c13d17700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4c0c0cb370 0x7f4c0c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c13d17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c0c0cc8f0 0x7f4c0c1f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c13d17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c148a80 con 0x7f4c0c0cc8f0 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c13d17700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1fa360 con 0x7f4c0c0cb370 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c13d17700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1fa640 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0c1a70 0x7f4c0c1f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0c1a70 0x7f4c0c1f9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48592/0 (socket says 172.21.15.26:48592) 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 -- 172.21.15.26:0/2972637626 learned_addr learned my addr 172.21.15.26:0/2972637626 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c122b4700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c0c0cc8f0 0x7f4c0c1f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 -- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4c0c0cb370 msgr2=0x7f4c0c148f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4c0c0cb370 0x7f4c0c148f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 -- 172.21.15.26:0/2972637626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c0c0cc8f0 msgr2=0x7f4c0c1f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c0c0cc8f0 0x7f4c0c1f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f4c11ab3700 1 -- 172.21.15.26:0/2972637626 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009b30 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.420+0000 7f63a53dd700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a0158900 0x7f63a00c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f63a4bdc700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a0158900 0x7f63a00c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f63a4bdc700 1 -- 172.21.15.26:0/2112875430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639800f050 con 0x7f63a006a890 2023-06-09T04:38:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.422+0000 7f63a53dd700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a0158900 0x7f63a00c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7fb296cbf700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] conn(0x7fb2780015e0 0x7fb278003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7f31899a0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31840ae760 0x7f31840b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48598/0 (socket says 172.21.15.26:48598) 2023-06-09T04:38:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7f31899a0700 1 -- 172.21.15.26:0/3185968378 learned_addr learned my addr 172.21.15.26:0/3185968378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7fb296cbf700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] conn(0x7fb2780015e0 0x7fb278003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7f0e86ffd700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0e7406acb0 0x7f0e7406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7fdbc63e1700 1 -- start start 2023-06-09T04:38:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc63e1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc006dc40 0x7fdbc01ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc63e1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00710d0 0x7fdbc015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc63e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc00ae360 0x7fdbc0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc63e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00ad1c0 con 0x7fdbc00ae360 2023-06-09T04:38:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc63e1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0152860 con 0x7fdbc006dc40 2023-06-09T04:38:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc63e1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00addd0 con 0x7fdbc00710d0 2023-06-09T04:38:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbbf7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00710d0 0x7fdbc015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbbffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc006dc40 0x7fdbc01ff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbbf7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00710d0 0x7fdbc015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48608/0 (socket says 172.21.15.26:48608) 2023-06-09T04:38:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbbf7fe700 1 -- 172.21.15.26:0/3132670823 learned_addr learned my addr 172.21.15.26:0/3132670823 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fdbc497e700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc00ae360 0x7fdbc0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fb295cbd700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb27406ace0 0x7fb27406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.423+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8300b12e0 con 0x7fc8300b0140 2023-06-09T04:38:21.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc820007450 con 0x7fc8300b0140 2023-06-09T04:38:21.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fc817fff700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc81c06ace0 0x7fc81c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e80088630 con 0x7f0e9006de50 2023-06-09T04:38:21.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f0e86ffd700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] conn(0x7f0e740734e0 0x7f0e740758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 --> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e74075fa0 con 0x7f0e740734e0 2023-06-09T04:38:21.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e8008acf0 con 0x7f0e9006de50 2023-06-09T04:38:21.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] conn(0x7f0e740734e0 0x7f0e740758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f4c11ab3700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0c1a70 0x7f4c0c1f9b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009fd0 tx=0x7f4c04004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f63a4bdc700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a006a890 0x7f63a00c5cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63a00b1300 tx=0x7f6398004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06f4019980 con 0x7f06fc089b80 2023-06-09T04:38:21.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f06f27fc700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06e006adb0 0x7f06e006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06f4014070 con 0x7f06fc089b80 2023-06-09T04:38:21.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f06f27fc700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] conn(0x7f06e00735e0 0x7f06e00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 --> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06e00760a0 con 0x7f06e00735e0 2023-06-09T04:38:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fdbbffff700 1 -- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00710d0 msgr2=0x7fdbc015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fdbbffff700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdbc00710d0 0x7fdbc015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fdbbffff700 1 -- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc00ae360 msgr2=0x7fdbc0159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fdbbffff700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc00ae360 0x7fdbc0159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fdbbffff700 1 -- 172.21.15.26:0/3132670823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8009b30 con 0x7fdbc006dc40 2023-06-09T04:38:21.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04004590 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040046f0 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04025460 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f31899a0700 1 -- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31840aecd0 msgr2=0x7f31841eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f31899a0700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31840aecd0 0x7f31841eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f31899a0700 1 -- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3184159080 msgr2=0x7f31841ef450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f31899a0700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3184159080 0x7f31841ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f31899a0700 1 -- 172.21.15.26:0/3185968378 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318000b7f0 con 0x7f31840ae760 2023-06-09T04:38:21.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.424+0000 7f31899a0700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31840ae760 0x7f31840b5130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f317400d800 tx=0x7f317400dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f0e8ed9d700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] conn(0x7f0e740734e0 0x7f0e740758f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f07021b1700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] conn(0x7f06e00735e0 0x7f06e00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fb295cbd700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb27406ace0 0x7fb27406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2901e0490 tx=0x7fb28c007a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc820089260 con 0x7fc8300b0140 2023-06-09T04:38:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fc817fff700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] conn(0x7fc81c073490 0x7fc81c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 --> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc81c075f50 con 0x7fc81c073490 2023-06-09T04:38:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== osd.3 v2:172.21.15.26:6824/2290214503 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb278006bc0 con 0x7fb2780015e0 2023-06-09T04:38:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f0e87fff700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0e7406acb0 0x7f0e7406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06f40070e0 con 0x7f06fc089b80 2023-06-09T04:38:21.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800d690 con 0x7f63a006a890 2023-06-09T04:38:21.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639800b800 con 0x7f63a006a890 2023-06-09T04:38:21.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800bbb0 con 0x7f63a006a890 2023-06-09T04:38:21.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a00c7010 con 0x7f63a006a890 2023-06-09T04:38:21.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a00b42f0 con 0x7f63a006a890 2023-06-09T04:38:21.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c148710 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c1fa920 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7f0e87fff700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0e7406acb0 0x7f0e7406d160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800d370 tx=0x7f0e7800a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174018070 con 0x7f31840ae760 2023-06-09T04:38:21.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3174005a20 con 0x7f31840ae760 2023-06-09T04:38:21.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174005bb0 con 0x7f31840ae760 2023-06-09T04:38:21.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fc82ffff700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] conn(0x7fc81c073490 0x7fc81c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7fc82effd700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc81c06ace0 0x7fc81c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7fc82ffff700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] conn(0x7fc81c073490 0x7fc81c0758a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7fdbbffff700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc006dc40 0x7fdbc01ff0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000b450 tx=0x7fdbb000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.425+0000 7f07011af700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06e006adb0 0x7f06e006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7f07011af700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06e006adb0 0x7f06e006d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0cd9f0 tx=0x7f06f8018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== osd.5 v2:172.21.15.104:6824/397687055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0e74075fa0 con 0x7f0e740734e0 2023-06-09T04:38:21.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7fc82effd700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc81c06ace0 0x7fc81c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc824006fd0 tx=0x7fc824008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.426+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc820054310 con 0x7fc8300b0140 2023-06-09T04:38:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7f07021b1700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] conn(0x7f06e00735e0 0x7f06e00759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0011830 con 0x7fdbc006dc40 2023-06-09T04:38:21.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0011990 con 0x7fdbc006dc40 2023-06-09T04:38:21.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0011d40 con 0x7fdbc006dc40 2023-06-09T04:38:21.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc00ac820 con 0x7fdbc006dc40 2023-06-09T04:38:21.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc00acde0 con 0x7fdbc006dc40 2023-06-09T04:38:21.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31841f12b0 con 0x7f31840ae760 2023-06-09T04:38:21.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31841ef160 con 0x7f31840ae760 2023-06-09T04:38:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c040255c0 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bf4000fc0 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f4c027fc700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4bf006adb0 0x7f4bf006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c0408b6e0 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63a00c6bc0 con 0x7f63a006a890 2023-06-09T04:38:21.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.427+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== osd.4 v2:172.21.15.104:6808/424802580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc81c075f50 con 0x7fc81c073490 2023-06-09T04:38:21.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f4c027fc700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] conn(0x7f4bf00735e0 0x7f4bf00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 --> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bf00760a0 con 0x7f4bf00735e0 2023-06-09T04:38:21.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f4c122b4700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] conn(0x7f4bf00735e0 0x7f4bf00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c04056780 con 0x7f4c0c0c1a70 2023-06-09T04:38:21.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.429+0000 7f4c122b4700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] conn(0x7f4bf00735e0 0x7f4bf00759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.429+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f639800bd10 con 0x7f63a006a890 2023-06-09T04:38:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.429+0000 7f4c112b2700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4bf006adb0 0x7f4bf006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.428+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbc00cd7f0 con 0x7fdbc006dc40 2023-06-09T04:38:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.429+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31840cd430 con 0x7f31840ae760 2023-06-09T04:38:21.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.429+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbb001a400 con 0x7fdbc006dc40 2023-06-09T04:38:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f4c112b2700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4bf006adb0 0x7f4bf006d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc006fd0 tx=0x7f4bfc006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f639d7fa700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f638c06ad60 0x7f638c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f639809b710 con 0x7f63a006a890 2023-06-09T04:38:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f639d7fa700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] conn(0x7f638c073610 0x7f638c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 --> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f638c0760d0 con 0x7f638c073610 2023-06-09T04:38:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f639809dda0 con 0x7f63a006a890 2023-06-09T04:38:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3174005d10 con 0x7f31840ae760 2023-06-09T04:38:21.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7fdbbcff9700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdbac06adb0 0x7fdbac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbb0089380 con 0x7fdbc006dc40 2023-06-09T04:38:21.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7fdbbcff9700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] conn(0x7fdbac0735e0 0x7fdbac0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 --> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbac0760a0 con 0x7fdbac0735e0 2023-06-09T04:38:21.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbb0011ea0 con 0x7fdbc006dc40 2023-06-09T04:38:21.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== osd.6 v2:172.21.15.104:6809/1716080601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4bf00760a0 con 0x7f4bf00735e0 2023-06-09T04:38:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f639ffff700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f638c06ad60 0x7f638c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.430+0000 7f63a53dd700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] conn(0x7f638c073610 0x7f638c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7fdbc497e700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] conn(0x7fdbac0735e0 0x7fdbac0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7fdbbf7fe700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdbac06adb0 0x7fdbac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f317a7fc700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f316806ad30 0x7f316806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3174088f50 con 0x7f31840ae760 2023-06-09T04:38:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f317a7fc700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] conn(0x7f3168073560 0x7f3168075970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 --> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3168076020 con 0x7f3168073560 2023-06-09T04:38:21.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3174054170 con 0x7f31840ae760 2023-06-09T04:38:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f318a1a1700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] conn(0x7f3168073560 0x7f3168075970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f63a53dd700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] conn(0x7f638c073610 0x7f638c075a20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7fdbbf7fe700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdbac06adb0 0x7fdbac06d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006d700 tx=0x7fdbb4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7fdbc497e700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] conn(0x7fdbac0735e0 0x7fdbac0759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.432+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== osd.7 v2:172.21.15.104:6800/1608970097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f638c0760d0 con 0x7f638c073610 2023-06-09T04:38:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.432+0000 7f318a1a1700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] conn(0x7f3168073560 0x7f3168075970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.432+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== osd.1 v2:172.21.15.26:6800/2969833146 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdbac0760a0 con 0x7fdbac0735e0 2023-06-09T04:38:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.433+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== osd.2 v2:172.21.15.26:6816/2836286982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3168076020 con 0x7f3168073560 2023-06-09T04:38:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.431+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== osd.0 v2:172.21.15.26:6808/2356311551 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06e00760a0 con 0x7f06e00735e0 2023-06-09T04:38:21.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.439+0000 7f318919f700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f316806ad30 0x7f316806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.459+0000 7f639ffff700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f638c06ad60 0x7f638c06d210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63a00c5200 tx=0x7f6390008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.459+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 --> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e9006d370 con 0x7f0e740734e0 2023-06-09T04:38:21.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.460+0000 7f0e86ffd700 1 -- 172.21.15.26:0/1842910287 <== osd.5 v2:172.21.15.104:6824/397687055 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e88001980 con 0x7f0e740734e0 2023-06-09T04:38:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.461+0000 7f318919f700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f316806ad30 0x7f316806d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3184202260 tx=0x7f3180012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.461+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 --> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8300b1000 con 0x7fc81c073490 2023-06-09T04:38:21.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] conn(0x7f0e740734e0 msgr2=0x7f0e740758f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6824/397687055,v1:172.21.15.104:6825/397687055] conn(0x7f0e740734e0 0x7f0e740758f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 --> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63a00ccaa0 con 0x7f638c073610 2023-06-09T04:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 --> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb278005c40 con 0x7fb2780015e0 2023-06-09T04:38:21.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 --> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bf4002d40 con 0x7f4bf00735e0 2023-06-09T04:38:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0e7406acb0 msgr2=0x7f0e7406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0e7406acb0 0x7f0e7406d160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800d370 tx=0x7f0e7800a000 comp rx=0 tx=0).stop 2023-06-09T04:38:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 msgr2=0x7f0e9020b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 --2- 172.21.15.26:0/1842910287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e9006de50 0x7f0e9020b700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000c500 tx=0x7f0e8000c8c0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e8ed9d700 1 -- 172.21.15.26:0/1842910287 reap_dead start 2023-06-09T04:38:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 shutdown_connections 2023-06-09T04:38:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 >> 172.21.15.26:0/1842910287 conn(0x7f0e90069db0 msgr2=0x7f0e900b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 shutdown_connections 2023-06-09T04:38:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f0e9491a700 1 -- 172.21.15.26:0/1842910287 wait complete. 2023-06-09T04:38:21.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f4c027fc700 1 -- 172.21.15.26:0/2972637626 <== osd.6 v2:172.21.15.104:6809/1716080601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4bf4002d40 con 0x7f4bf00735e0 2023-06-09T04:38:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.462+0000 7f639d7fa700 1 -- 172.21.15.26:0/2112875430 <== osd.7 v2:172.21.15.104:6800/1608970097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6394001450 con 0x7f638c073610 2023-06-09T04:38:21.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb286ffd700 1 -- 172.21.15.26:0/3907363142 <== osd.3 v2:172.21.15.26:6824/2290214503 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb278005c40 con 0x7fb2780015e0 2023-06-09T04:38:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] conn(0x7fb2780015e0 msgr2=0x7fb278003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:6824/2290214503,v1:172.21.15.26:6825/2290214503] conn(0x7fb2780015e0 0x7fb278003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb27406ace0 msgr2=0x7fb27406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb27406ace0 0x7fb27406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2901e0490 tx=0x7fb28c007a30 comp rx=0 tx=0).stop 2023-06-09T04:38:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb29006ea70 msgr2=0x7fb2900b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 --2- 172.21.15.26:0/3907363142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb29006ea70 0x7fb2900b42d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb28000c450 tx=0x7fb28000c810 comp rx=0 tx=0).stop 2023-06-09T04:38:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb296cbf700 1 -- 172.21.15.26:0/3907363142 reap_dead start 2023-06-09T04:38:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 shutdown_connections 2023-06-09T04:38:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.463+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 >> 172.21.15.26:0/3907363142 conn(0x7fb290098a30 msgr2=0x7fb2900b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc817fff700 1 -- 172.21.15.26:0/2627287332 <== osd.4 v2:172.21.15.104:6808/424802580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc828003cb0 con 0x7fc81c073490 2023-06-09T04:38:21.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 --> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31840cd020 con 0x7f3168073560 2023-06-09T04:38:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 shutdown_connections 2023-06-09T04:38:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fb298722700 1 -- 172.21.15.26:0/3907363142 wait complete. 2023-06-09T04:38:21.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] conn(0x7f638c073610 msgr2=0x7f638c075a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f63a6e40700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6800/1608970097,v1:172.21.15.104:6801/1608970097] conn(0x7f638c073610 0x7f638c075a20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f317a7fc700 1 -- 172.21.15.26:0/3185968378 <== osd.2 v2:172.21.15.26:6816/2836286982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f317c001870 con 0x7f3168073560 2023-06-09T04:38:21.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] conn(0x7fc81c073490 msgr2=0x7fc81c0758a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6808/424802580,v1:172.21.15.104:6810/424802580] conn(0x7fc81c073490 0x7fc81c0758a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc81c06ace0 msgr2=0x7fc81c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc81c06ace0 0x7fc81c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc824006fd0 tx=0x7fc824008040 comp rx=0 tx=0).stop 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 msgr2=0x7fc8300c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 --2- 172.21.15.26:0/2627287332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc8300b0140 0x7fc8300c3d20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c730 tx=0x7fc82000caf0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc82ffff700 1 -- 172.21.15.26:0/2627287332 reap_dead start 2023-06-09T04:38:21.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 shutdown_connections 2023-06-09T04:38:21.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 >> 172.21.15.26:0/2627287332 conn(0x7fc830089fc0 msgr2=0x7fc8300b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] conn(0x7f4bf00735e0 msgr2=0x7f4bf00759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f4c13d17700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6809/1716080601,v1:172.21.15.104:6811/1716080601] conn(0x7f4bf00735e0 0x7f4bf00759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f638c06ad60 msgr2=0x7f638c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f63a6e40700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f638c06ad60 0x7f638c06d210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63a00c5200 tx=0x7f6390008040 comp rx=0 tx=0).stop 2023-06-09T04:38:21.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a006a890 msgr2=0x7f63a00c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.464+0000 7f63a6e40700 1 --2- 172.21.15.26:0/2112875430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a006a890 0x7f63a00c5cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63a00b1300 tx=0x7f6398004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] conn(0x7f3168073560 msgr2=0x7f3168075970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.26:6816/2836286982,v1:172.21.15.26:6817/2836286982] conn(0x7f3168073560 0x7f3168075970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f316806ad30 msgr2=0x7f316806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f316806ad30 0x7f316806d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3184202260 tx=0x7f3180012000 comp rx=0 tx=0).stop 2023-06-09T04:38:21.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 shutdown_connections 2023-06-09T04:38:21.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31840ae760 msgr2=0x7f31840b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 --2- 172.21.15.26:0/3185968378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31840ae760 0x7f31840b5130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f317400d800 tx=0x7f317400dbc0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7fc836162700 1 -- 172.21.15.26:0/2627287332 wait complete. 2023-06-09T04:38:21.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318a1a1700 1 -- 172.21.15.26:0/3185968378 reap_dead start 2023-06-09T04:38:21.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 shutdown_connections 2023-06-09T04:38:21.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 >> 172.21.15.26:0/3185968378 conn(0x7f3184098b50 msgr2=0x7f31840ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 shutdown_connections 2023-06-09T04:38:21.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 --> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbc0159890 con 0x7fdbac0735e0 2023-06-09T04:38:21.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7fdbbcff9700 1 -- 172.21.15.26:0/3132670823 <== osd.1 v2:172.21.15.26:6800/2969833146 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdbb8003b90 con 0x7fdbac0735e0 2023-06-09T04:38:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4bf006adb0 msgr2=0x7f4bf006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c13d17700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4bf006adb0 0x7f4bf006d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc006fd0 tx=0x7f4bfc006bc0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0c1a70 msgr2=0x7f4c0c1f9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c13d17700 1 --2- 172.21.15.26:0/2972637626 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4c0c0c1a70 0x7f4c0c1f9b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009fd0 tx=0x7f4c04004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c122b4700 1 -- 172.21.15.26:0/2972637626 reap_dead start 2023-06-09T04:38:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 shutdown_connections 2023-06-09T04:38:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 >> 172.21.15.26:0/2972637626 conn(0x7f4c0c069db0 msgr2=0x7f4c0c0cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 --> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06fc06c990 con 0x7f06e00735e0 2023-06-09T04:38:21.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7f06f27fc700 1 -- 172.21.15.26:0/2457392418 <== osd.0 v2:172.21.15.26:6808/2356311551 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06ec00d940 con 0x7f06e00735e0 2023-06-09T04:38:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] conn(0x7fdbac0735e0 msgr2=0x7fdbac0759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.26:6800/2969833146,v1:172.21.15.26:6801/2969833146] conn(0x7fdbac0735e0 0x7fdbac0759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdbac06adb0 msgr2=0x7fdbac06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdbac06adb0 0x7fdbac06d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006d700 tx=0x7fdbb4009190 comp rx=0 tx=0).stop 2023-06-09T04:38:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc006dc40 msgr2=0x7fdbc01ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 --2- 172.21.15.26:0/3132670823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbc006dc40 0x7fdbc01ff0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000b450 tx=0x7fdbb000b760 comp rx=0 tx=0).stop 2023-06-09T04:38:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc497e700 1 -- 172.21.15.26:0/3132670823 reap_dead start 2023-06-09T04:38:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 shutdown_connections 2023-06-09T04:38:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 >> 172.21.15.26:0/3132670823 conn(0x7fdbc00cb9d0 msgr2=0x7fdbc006a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 shutdown_connections 2023-06-09T04:38:21.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.466+0000 7fdbc63e1700 1 -- 172.21.15.26:0/3132670823 wait complete. 2023-06-09T04:38:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] conn(0x7f06e00735e0 msgr2=0x7f06e00759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.26:6808/2356311551,v1:172.21.15.26:6809/2356311551] conn(0x7f06e00735e0 0x7f06e00759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06e006adb0 msgr2=0x7f06e006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06e006adb0 0x7f06e006d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0cd9f0 tx=0x7f06f8018000 comp rx=0 tx=0).stop 2023-06-09T04:38:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 msgr2=0x7f06fc0c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 --2- 172.21.15.26:0/2457392418 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06fc089b80 0x7f06fc0c57e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06f400df20 tx=0x7f06f400c4c0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f07021b1700 1 -- 172.21.15.26:0/2457392418 reap_dead start 2023-06-09T04:38:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 shutdown_connections 2023-06-09T04:38:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 >> 172.21.15.26:0/2457392418 conn(0x7f06fc069db0 msgr2=0x7f06fc0cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 shutdown_connections 2023-06-09T04:38:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.467+0000 7f0703c14700 1 -- 172.21.15.26:0/2457392418 wait complete. 2023-06-09T04:38:21.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.465+0000 7f318bc04700 1 -- 172.21.15.26:0/3185968378 wait complete. 2023-06-09T04:38:21.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.474+0000 7f63a53dd700 1 -- 172.21.15.26:0/2112875430 reap_dead start 2023-06-09T04:38:21.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.474+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 shutdown_connections 2023-06-09T04:38:21.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.474+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 >> 172.21.15.26:0/2112875430 conn(0x7f63a0069db0 msgr2=0x7f63a00aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.474+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 shutdown_connections 2023-06-09T04:38:21.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.474+0000 7f4c13d17700 1 -- 172.21.15.26:0/2972637626 wait complete. 2023-06-09T04:38:21.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.479+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 shutdown_connections 2023-06-09T04:38:21.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.483+0000 7f63a6e40700 1 -- 172.21.15.26:0/2112875430 wait complete. 2023-06-09T04:38:21.540 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-06-09T04:38:21.540 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-06-09T04:38:21.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:38:21.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:38:21.542 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-06-09T04:38:21.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:38:21.543 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-06-09T04:38:21.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:38:21.544 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-06-09T04:38:21.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:38:21.545 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-06-09T04:38:21.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:38:21.546 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-06-09T04:38:21.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:38:21.547 INFO:teuthology.orchestra.run.smithi026.stdout:60129542153 2023-06-09T04:38:21.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:38:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.800+0000 7fbd4be76700 1 Processor -- start 2023-06-09T04:38:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.801+0000 7fbd4be76700 1 -- start start 2023-06-09T04:38:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd4be76700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd44158900 0x7fbd4415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd4be76700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd440c9b80 con 0x7fbd4406a890 2023-06-09T04:38:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd4be76700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd440ccab0 con 0x7fbd440cc630 2023-06-09T04:38:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd4be76700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440ccd80 con 0x7fbd44158900 2023-06-09T04:38:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd49411700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbd4406a890 0x7fbd440c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46844/0 (socket says 172.21.15.26:46844) 2023-06-09T04:38:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd49411700 1 -- 172.21.15.26:0/3536549144 learned_addr learned my addr 172.21.15.26:0/3536549144 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd49c12700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd44158900 0x7fbd4415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119783900 0 0) 0x7fbd440c9b80 con 0x7fbd4406a890 2023-06-09T04:38:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.802+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd300035b0 con 0x7fbd4406a890 2023-06-09T04:38:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2763884097 0 0) 0x7fbd300035b0 con 0x7fbd4406a890 2023-06-09T04:38:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd44158900 msgr2=0x7fbd4415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd44158900 0x7fbd4415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 >> v1:172.21.15.104:6789/0 conn(0x7fbd440cc630 legacy=0x7fbd440c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4415c380 con 0x7fbd4406a890 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fbd3c0019f0 con 0x7fbd4406a890 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 >> v1:172.21.15.26:6789/0 conn(0x7fbd4406a890 legacy=0x7fbd440c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30003a30 0x7fbd30003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd30004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30005200 0x7fbd3000fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440ccd80 con 0x7fbd30005200 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300079f0 con 0x7fbd30003a30 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30007bb0 con 0x7fbd30004850 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.803+0000 7fbd49411700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd30004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fbd49411700 1 -- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30003a30 msgr2=0x7fbd30003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fbd49411700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd30003a30 0x7fbd30003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fbd49411700 1 -- 172.21.15.26:0/3536549144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30005200 msgr2=0x7fbd3000fe20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fbd49411700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd30005200 0x7fbd3000fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fbd49411700 1 -- 172.21.15.26:0/3536549144 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd300035b0 con 0x7fbd30004850 2023-06-09T04:38:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fa740d22700 1 Processor -- start 2023-06-09T04:38:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.804+0000 7fa740d22700 1 -- start start 2023-06-09T04:38:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7f8c3fa31700 1 Processor -- start 2023-06-09T04:38:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7f8c3fa31700 1 -- start start 2023-06-09T04:38:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7fa740d22700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa73c0b0190 0x7fa73c0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7fa740d22700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c06de50 0x7fa73c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7fa740d22700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa73c0b0d30 0x7fa73c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7fa740d22700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c089e80 con 0x7fa73c0b0d30 2023-06-09T04:38:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7fa740d22700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c169670 con 0x7fa73c0b0190 2023-06-09T04:38:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7fa740d22700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b0aa0 con 0x7fa73c06de50 2023-06-09T04:38:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fa99186a700 1 Processor -- start 2023-06-09T04:38:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fbd49411700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd30004cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00a850 tx=0x7fbd30005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9925b7e29234bac server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7f9f28c70700 1 Processor -- start 2023-06-09T04:38:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.805+0000 7f9f28c70700 1 -- start start 2023-06-09T04:38:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fa99186a700 1 -- start start 2023-06-09T04:38:21.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012600 con 0x7fbd30004850 2023-06-09T04:38:21.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c012780 con 0x7fbd30004850 2023-06-09T04:38:21.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fbd48c10700 1 -- 172.21.15.26:0/3536549144 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012b30 con 0x7fbd30004850 2023-06-09T04:38:21.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f28c70700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9f240cc8f0 0x7f9f24164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f28c70700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9f240c1a70 0x7f9f241618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f28c70700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240cb370 0x7f9f240cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f28c70700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240cbd30 con 0x7f9f240cc8f0 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f28c70700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f24164ba0 con 0x7f9f240c1a70 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f28c70700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24164e00 con 0x7f9f240cb370 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9f240c1a70 0x7f9f241618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9f240c1a70 0x7f9f241618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45118/0 (socket says 172.21.15.26:45118) 2023-06-09T04:38:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 -- 172.21.15.26:0/1363141444 learned_addr learned my addr 172.21.15.26:0/1363141444 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa99186a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa98c0cc040 0x7fa98c0c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa99186a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa98c0c2cf0 0x7fa98c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa99186a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0c30f0 con 0x7fa98c1608b0 2023-06-09T04:38:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa99186a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0cc4b0 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa99186a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0cc790 con 0x7fa98c0cc040 2023-06-09T04:38:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f22d9d700 1 --2- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240cb370 0x7f9f240cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f2259c700 1 --2- 172.21.15.26:0/1363141444 >> v2:172.21.15.26:3300/0 conn(0x7f9f240cc8f0 0x7f9f24164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fa739d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c06de50 0x7fa73c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fa73ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa73c0b0d30 0x7fa73c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fa73ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa73c0b0d30 0x7fa73c0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37992/0 (socket says 172.21.15.26:37992) 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7fa73ad9d700 1 -- 172.21.15.26:0/1879566150 learned_addr learned my addr 172.21.15.26:0/1879566150 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa73ad9d700 1 -- 172.21.15.26:0/1879566150 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c06de50 msgr2=0x7fa73c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa73ad9d700 1 --2- 172.21.15.26:0/1879566150 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c06de50 0x7fa73c0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa73ad9d700 1 -- 172.21.15.26:0/1879566150 >> v2:172.21.15.104:3300/0 conn(0x7fa73c0b0190 msgr2=0x7fa73c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa73ad9d700 1 --2- 172.21.15.26:0/1879566150 >> v2:172.21.15.104:3300/0 conn(0x7fa73c0b0190 0x7fa73c0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa73ad9d700 1 -- 172.21.15.26:0/1879566150 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c06cdb0 con 0x7fa73c0b0d30 2023-06-09T04:38:21.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa73ad9d700 1 --2- 172.21.15.26:0/1879566150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 0x7fa73c0cade0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa73c06ab30 tx=0x7fa72c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a67e2812af1d5cd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 -- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240cb370 msgr2=0x7f9f240cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240cb370 0x7f9f240cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 -- 172.21.15.26:0/1363141444 >> v2:172.21.15.26:3300/0 conn(0x7f9f240cc8f0 msgr2=0x7f9f24164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/1363141444 >> v2:172.21.15.26:3300/0 conn(0x7f9f240cc8f0 0x7f9f24164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f9f21d9b700 1 -- 172.21.15.26:0/1363141444 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f241650e0 con 0x7f9f240c1a70 2023-06-09T04:38:21.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa98affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa98c1608b0 0x7fa98c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46864/0 (socket says 172.21.15.26:46864) 2023-06-09T04:38:21.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fa98affd700 1 -- 172.21.15.26:0/1060270133 learned_addr learned my addr 172.21.15.26:0/1060270133 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7f8c3fa31700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7f8c3fa31700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c3806dc40 0x7f8c3806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7f8c3fa31700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c38159030 con 0x7f8c380709c0 2023-06-09T04:38:21.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7f8c3fa31700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3806e190 con 0x7f8c3806dc40 2023-06-09T04:38:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.806+0000 7f8c3fa31700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381592d0 con 0x7f8c380ae360 2023-06-09T04:38:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f8c3cfcc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f8c3cfcc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48654/0 (socket says 172.21.15.26:48654) 2023-06-09T04:38:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/2742877908 learned_addr learned my addr 172.21.15.26:0/2742877908 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fbd4be76700 1 -- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 msgr2=0x7fbd30004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7fbd4be76700 1 --2- 172.21.15.26:0/3536549144 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd30004cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00a850 tx=0x7fbd30005880 comp rx=0 tx=0).stop 2023-06-09T04:38:21.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa98a7fc700 1 --2- 172.21.15.26:0/1060270133 >> v2:172.21.15.104:3300/0 conn(0x7fa98c0cc040 0x7fa98c0c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fbd4a413700 1 -- 172.21.15.26:0/3536549144 reap_dead start 2023-06-09T04:38:21.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fbd4be76700 1 -- 172.21.15.26:0/3536549144 shutdown_connections 2023-06-09T04:38:21.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fbd4be76700 1 -- 172.21.15.26:0/3536549144 >> 172.21.15.26:0/3536549144 conn(0x7fbd44069db0 msgr2=0x7fbd4406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/2742877908 >> v2:172.21.15.26:3300/0 conn(0x7f8c3806dc40 msgr2=0x7f8c3806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c3cfcc700 1 --2- 172.21.15.26:0/2742877908 >> v2:172.21.15.26:3300/0 conn(0x7f8c3806dc40 0x7f8c3806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/2742877908 >> v1:172.21.15.104:6789/0 conn(0x7f8c380709c0 legacy=0x7f8c38070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/2742877908 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c381595b0 con 0x7f8c380ae360 2023-06-09T04:38:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa98b7fe700 1 --2- 172.21.15.26:0/1060270133 >> v2:172.21.15.26:3300/0 conn(0x7fa98c0c2cf0 0x7fa98c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa98a7fc700 1 -- 172.21.15.26:0/1060270133 >> v2:172.21.15.26:3300/0 conn(0x7fa98c0c2cf0 msgr2=0x7fa98c0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa98a7fc700 1 --2- 172.21.15.26:0/1060270133 >> v2:172.21.15.26:3300/0 conn(0x7fa98c0c2cf0 0x7fa98c0ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa98a7fc700 1 -- 172.21.15.26:0/1060270133 >> v1:172.21.15.26:6789/0 conn(0x7fa98c1608b0 legacy=0x7fa98c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa98a7fc700 1 -- 172.21.15.26:0/1060270133 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0cca70 con 0x7fa98c0cc040 2023-06-09T04:38:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fbd4be76700 1 -- 172.21.15.26:0/3536549144 shutdown_connections 2023-06-09T04:38:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fbd4be76700 1 -- 172.21.15.26:0/3536549144 wait complete. 2023-06-09T04:38:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c3cfcc700 1 --2- 172.21.15.26:0/2742877908 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38069db0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098f0 tx=0x7f8c34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5909f3f5d88327 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240c1a70 0x7f9f241618e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f240cbf50 tx=0x7f9f14009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0cb764a585b65a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.807+0000 7f972333e700 1 Processor -- start 2023-06-09T04:38:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f972333e700 1 -- start start 2023-06-09T04:38:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f9f2159a700 1 -- 172.21.15.26:0/1363141444 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011830 con 0x7f9f240c1a70 2023-06-09T04:38:21.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f9f2159a700 1 -- 172.21.15.26:0/1363141444 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14011990 con 0x7f9f240c1a70 2023-06-09T04:38:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f9f2159a700 1 -- 172.21.15.26:0/1363141444 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011d00 con 0x7f9f240c1a70 2023-06-09T04:38:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa73959a700 1 -- 172.21.15.26:0/1879566150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011830 con 0x7fa73c0b0d30 2023-06-09T04:38:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa73959a700 1 -- 172.21.15.26:0/1879566150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c011990 con 0x7fa73c0b0d30 2023-06-09T04:38:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7fa73959a700 1 -- 172.21.15.26:0/1879566150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011d00 con 0x7fa73c0b0d30 2023-06-09T04:38:21.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c2ffff700 1 -- 172.21.15.26:0/2742877908 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400c9b0 con 0x7f8c380ae360 2023-06-09T04:38:21.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c2ffff700 1 -- 172.21.15.26:0/2742877908 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3400cb10 con 0x7f8c380ae360 2023-06-09T04:38:21.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.808+0000 7f8c2ffff700 1 -- 172.21.15.26:0/2742877908 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400cea0 con 0x7f8c380ae360 2023-06-09T04:38:21.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7fa98a7fc700 1 --2- 172.21.15.26:0/1060270133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0cc040 0x7fa98c0c27b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0c9d30 tx=0x7fa980009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b0fdfb23232e2e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7fa740d22700 1 -- 172.21.15.26:0/1879566150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 msgr2=0x7fa73c0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7fa740d22700 1 --2- 172.21.15.26:0/1879566150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 0x7fa73c0cade0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa73c06ab30 tx=0x7fa72c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f8c3fa31700 1 -- 172.21.15.26:0/2742877908 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 msgr2=0x7f8c38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/2742877908 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38069db0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098f0 tx=0x7f8c34009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:21.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f9f28c70700 1 -- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240c1a70 msgr2=0x7f9f241618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f9f28c70700 1 --2- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240c1a70 0x7f9f241618e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f240cbf50 tx=0x7f9f14009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f8c3fa31700 1 -- 172.21.15.26:0/2742877908 shutdown_connections 2023-06-09T04:38:21.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/2742877908 >> v2:172.21.15.26:3300/0 conn(0x7f8c3806dc40 0x7f8c3806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/2742877908 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38069db0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f8c3fa31700 1 -- 172.21.15.26:0/2742877908 >> 172.21.15.26:0/2742877908 conn(0x7f8c380cb9d0 msgr2=0x7f8c380cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7fa989ffb700 1 -- 172.21.15.26:0/1060270133 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980004230 con 0x7fa98c0cc040 2023-06-09T04:38:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7fbd4be76700 1 Processor -- start 2023-06-09T04:38:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f8c3fa31700 1 -- 172.21.15.26:0/2742877908 shutdown_connections 2023-06-09T04:38:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fcf296d1700 1 Processor -- start 2023-06-09T04:38:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7fa989ffb700 1 -- 172.21.15.26:0/1060270133 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980004390 con 0x7fa98c0cc040 2023-06-09T04:38:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7fa989ffb700 1 -- 172.21.15.26:0/1060270133 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800036a0 con 0x7fa98c0cc040 2023-06-09T04:38:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa99186a700 1 -- 172.21.15.26:0/1060270133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0cc040 msgr2=0x7fa98c0c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa99186a700 1 --2- 172.21.15.26:0/1060270133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0cc040 0x7fa98c0c27b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0c9d30 tx=0x7fa980009b20 comp rx=0 tx=0).stop 2023-06-09T04:38:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f9f28c70700 1 -- 172.21.15.26:0/1363141444 shutdown_connections 2023-06-09T04:38:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f9f28c70700 1 --2- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240cb370 0x7f9f240cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f9f28c70700 1 --2- 172.21.15.26:0/1363141444 >> v2:172.21.15.26:3300/0 conn(0x7f9f240cc8f0 0x7f9f24164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f9f28c70700 1 --2- 172.21.15.26:0/1363141444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240c1a70 0x7f9f241618e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f9f28c70700 1 -- 172.21.15.26:0/1363141444 >> 172.21.15.26:0/1363141444 conn(0x7f9f24069db0 msgr2=0x7f9f2406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7fbd4be76700 1 -- start start 2023-06-09T04:38:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4be76700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd4415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4be76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd44159ef0 0x7fbd4415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4be76700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 0x7fbd440c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4be76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd441f2080 con 0x7fbd44159ef0 2023-06-09T04:38:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4be76700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44158e50 con 0x7fbd440c73e0 2023-06-09T04:38:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4be76700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44159130 con 0x7fbd30004850 2023-06-09T04:38:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa740d22700 1 -- 172.21.15.26:0/1879566150 shutdown_connections 2023-06-09T04:38:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa740d22700 1 --2- 172.21.15.26:0/1879566150 >> v2:172.21.15.104:3300/0 conn(0x7fa73c0b0190 0x7fa73c0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa740d22700 1 --2- 172.21.15.26:0/1879566150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 0x7fa73c0cade0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa740d22700 1 --2- 172.21.15.26:0/1879566150 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c06de50 0x7fa73c0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa740d22700 1 -- 172.21.15.26:0/1879566150 >> 172.21.15.26:0/1879566150 conn(0x7fa73c069db0 msgr2=0x7fa73c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa99186a700 1 -- 172.21.15.26:0/1060270133 shutdown_connections 2023-06-09T04:38:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa99186a700 1 --2- 172.21.15.26:0/1060270133 >> v2:172.21.15.26:3300/0 conn(0x7fa98c0c2cf0 0x7fa98c0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa99186a700 1 --2- 172.21.15.26:0/1060270133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0cc040 0x7fa98c0c27b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fcf296d1700 1 -- start start 2023-06-09T04:38:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa99186a700 1 -- 172.21.15.26:0/1060270133 >> 172.21.15.26:0/1060270133 conn(0x7fa98c098b50 msgr2=0x7fa98c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4a413700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 0x7fbd440c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4a413700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 0x7fbd440c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45144/0 (socket says 172.21.15.26:45144) 2023-06-09T04:38:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fbd4a413700 1 -- 172.21.15.26:0/212666203 learned_addr learned my addr 172.21.15.26:0/212666203 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f8c3fa31700 1 -- 172.21.15.26:0/2742877908 wait complete. 2023-06-09T04:38:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f972333e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f971c06de50 0x7f971c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f972333e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0cce10 con 0x7f971c0cc9f0 2023-06-09T04:38:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f972333e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c06d090 con 0x7f971c0b0d30 2023-06-09T04:38:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.809+0000 7f972333e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c089e80 con 0x7f971c06de50 2023-06-09T04:38:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f97210da700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f971c06de50 0x7f971c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f97210da700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f971c06de50 0x7f971c0b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45138/0 (socket says 172.21.15.26:45138) 2023-06-09T04:38:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f97210da700 1 -- 172.21.15.26:0/3475515889 learned_addr learned my addr 172.21.15.26:0/3475515889 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7fa740d22700 1 -- 172.21.15.26:0/1879566150 shutdown_connections 2023-06-09T04:38:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f97218db700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f971c0cc9f0 0x7f971c0cade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46874/0 (socket says 172.21.15.26:46874) 2023-06-09T04:38:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483458822 0 0) 0x7f971c0cce10 con 0x7f971c0cc9f0 2023-06-09T04:38:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97080035b0 con 0x7f971c0cc9f0 2023-06-09T04:38:21.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906439857 0 0) 0x7f971c06d090 con 0x7f971c0b0d30 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c0cce10 con 0x7f971c0b0d30 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760505195 0 0) 0x7f97080035b0 con 0x7f971c0cc9f0 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 >> v2:172.21.15.104:3300/0 conn(0x7f971c06de50 msgr2=0x7f971c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 --2- 172.21.15.26:0/3475515889 >> v2:172.21.15.104:3300/0 conn(0x7f971c06de50 0x7f971c0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 >> v1:172.21.15.104:6789/0 conn(0x7f971c0b0d30 legacy=0x7f971c0cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c06d370 con 0x7f971c0cc9f0 2023-06-09T04:38:21.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f97140019f0 con 0x7f971c0cc9f0 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 >> v1:172.21.15.26:6789/0 conn(0x7f971c0cc9f0 legacy=0x7f971c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9708003bc0 0x7f9708003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9708004850 0x7f9708004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9708005250 0x7f970801ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718001230 con 0x7f9708005250 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c089e80 con 0x7f9708003bc0 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.810+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9708005a90 con 0x7f9708004850 2023-06-09T04:38:21.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97208d9700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9708004850 0x7f9708004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97218db700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9708005250 0x7f970801ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97208d9700 1 -- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9708003bc0 msgr2=0x7f9708003f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97208d9700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9708003bc0 0x7f9708003f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97208d9700 1 -- 172.21.15.26:0/3475515889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9708005250 msgr2=0x7f970801ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97208d9700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9708005250 0x7f970801ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97208d9700 1 -- 172.21.15.26:0/3475515889 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080035b0 con 0x7f9708004850 2023-06-09T04:38:21.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.811+0000 7f97218db700 1 -- 172.21.15.26:0/3475515889 reap_dead start 2023-06-09T04:38:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fa740d22700 1 -- 172.21.15.26:0/1879566150 wait complete. 2023-06-09T04:38:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fa99186a700 1 -- 172.21.15.26:0/1060270133 shutdown_connections 2023-06-09T04:38:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd49411700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd44159ef0 0x7fbd4415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd49c12700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd4415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf296d1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf2415c440 0x7fcf240cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf296d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf240b5930 0x7fcf240b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf296d1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf240d0070 0x7fcf240b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf296d1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf240cf350 con 0x7fcf240b5930 2023-06-09T04:38:21.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf296d1700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf240cd1d0 con 0x7fcf240d0070 2023-06-09T04:38:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf296d1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240cd4b0 con 0x7fcf2415c440 2023-06-09T04:38:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf227fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf240b5930 0x7fcf240b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf227fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf240b5930 0x7fcf240b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38030/0 (socket says 172.21.15.26:38030) 2023-06-09T04:38:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fcf227fc700 1 -- 172.21.15.26:0/563360303 learned_addr learned my addr 172.21.15.26:0/563360303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7f8c3fa31700 1 Processor -- start 2023-06-09T04:38:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7f97208d9700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9708004850 0x7f9708004cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f971c0b1170 tx=0x7f9708005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2953dc55dc3647f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf227fc700 1 -- 172.21.15.26:0/563360303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf2415c440 msgr2=0x7fcf240cee10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:38:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf227fc700 1 --2- 172.21.15.26:0/563360303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf2415c440 0x7fcf240cee10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf227fc700 1 -- 172.21.15.26:0/563360303 >> v2:172.21.15.104:3300/0 conn(0x7fcf240d0070 msgr2=0x7fcf240b4aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:38:21.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf227fc700 1 --2- 172.21.15.26:0/563360303 >> v2:172.21.15.104:3300/0 conn(0x7fcf240d0070 0x7fcf240b4aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf227fc700 1 -- 172.21.15.26:0/563360303 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240cd790 con 0x7fcf240b5930 2023-06-09T04:38:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf227fc700 1 --2- 172.21.15.26:0/563360303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf240b5930 0x7fcf240b4560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf24067750 tx=0x7fcf1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dbfa57b0b2dfcd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf21ffb700 1 -- 172.21.15.26:0/563360303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400e070 con 0x7fcf240b5930 2023-06-09T04:38:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf21ffb700 1 -- 172.21.15.26:0/563360303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1400b9c0 con 0x7fcf240b5930 2023-06-09T04:38:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fcf21ffb700 1 -- 172.21.15.26:0/563360303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400bd70 con 0x7fcf240b5930 2023-06-09T04:38:21.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fa99186a700 1 -- 172.21.15.26:0/1060270133 wait complete. 2023-06-09T04:38:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7fa99186a700 1 Processor -- start 2023-06-09T04:38:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7fa740d22700 1 Processor -- start 2023-06-09T04:38:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971800cca0 con 0x7f9708004850 2023-06-09T04:38:21.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971800ce00 con 0x7f9708004850 2023-06-09T04:38:21.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f9713fff700 1 -- 172.21.15.26:0/3475515889 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718012620 con 0x7f9708004850 2023-06-09T04:38:21.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd4a413700 1 -- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 msgr2=0x7fbd4415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd4a413700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd4415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd4a413700 1 -- 172.21.15.26:0/212666203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd44159ef0 msgr2=0x7fbd4415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd4a413700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd44159ef0 0x7fbd4415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd4a413700 1 -- 172.21.15.26:0/212666203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44159410 con 0x7fbd440c73e0 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7fbd4a413700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 0x7fbd440c7880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd440ce6a0 tx=0x7fbd3400c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34004220 con 0x7fbd440c73e0 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd340043a0 con 0x7fbd440c73e0 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd441596f0 con 0x7fbd440c73e0 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34007310 con 0x7fbd440c73e0 2023-06-09T04:38:21.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4415b7c0 con 0x7fbd440c73e0 2023-06-09T04:38:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.812+0000 7f8c3fa31700 1 -- start start 2023-06-09T04:38:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7f8c3fa31700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c3806dc40 0x7f8c38144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7f8c3fa31700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 0x7f8c381ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7f8c3fa31700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7f8c3fa31700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380adb50 con 0x7f8c3806dc40 2023-06-09T04:38:21.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7f8c3fa31700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380aced0 con 0x7f8c380709c0 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.813+0000 7f8c3fa31700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380ad1b0 con 0x7f8c380ae360 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 0x7f8c381ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 0x7f8c381ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45156/0 (socket says 172.21.15.26:45156) 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/874942016 learned_addr learned my addr 172.21.15.26:0/874942016 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3dfce700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 msgr2=0x7f8c38157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/874942016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c3806dc40 msgr2=0x7f8c38144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c3806dc40 0x7f8c38144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7f8c3cfcc700 1 -- 172.21.15.26:0/874942016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34009550 con 0x7f8c380709c0 2023-06-09T04:38:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7fcf296d1700 1 -- 172.21.15.26:0/563360303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf240b5930 msgr2=0x7fcf240b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7fcf296d1700 1 --2- 172.21.15.26:0/563360303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf240b5930 0x7fcf240b4560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf24067750 tx=0x7fcf1400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd44159c10 con 0x7fbd440c73e0 2023-06-09T04:38:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 -- 172.21.15.26:0/563360303 shutdown_connections 2023-06-09T04:38:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 --2- 172.21.15.26:0/563360303 >> v2:172.21.15.104:3300/0 conn(0x7fcf240d0070 0x7fcf240b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 --2- 172.21.15.26:0/563360303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf2415c440 0x7fcf240cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 --2- 172.21.15.26:0/563360303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf240b5930 0x7fcf240b4560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 -- 172.21.15.26:0/563360303 >> 172.21.15.26:0/563360303 conn(0x7fcf240cf560 msgr2=0x7fcf240cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f8c3cfcc700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 0x7f8c381ee700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c38159410 tx=0x7f8c34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 -- 172.21.15.26:0/563360303 shutdown_connections 2023-06-09T04:38:21.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3401c030 con 0x7f8c380709c0 2023-06-09T04:38:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3401d040 con 0x7f8c380709c0 2023-06-09T04:38:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34023bf0 con 0x7f8c380709c0 2023-06-09T04:38:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd34007470 con 0x7fbd440c73e0 2023-06-09T04:38:21.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f49ef77e700 1 Processor -- start 2023-06-09T04:38:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f9f28c70700 1 -- 172.21.15.26:0/1363141444 shutdown_connections 2023-06-09T04:38:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fbd3a7fc700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbd2806ace0 0x7fbd2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f49ef77e700 1 -- start start 2023-06-09T04:38:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f9f28c70700 1 -- 172.21.15.26:0/1363141444 wait complete. 2023-06-09T04:38:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7fa740d22700 1 -- start start 2023-06-09T04:38:21.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa740d22700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa73c06de50 0x7fa73c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa740d22700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 0x7fa73c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa740d22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 0x7fa73c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa740d22700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0864d0 con 0x7fa73c0b0d30 2023-06-09T04:38:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa740d22700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0867b0 con 0x7fa73c06de50 2023-06-09T04:38:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa740d22700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c086a90 con 0x7fa73c0b0190 2023-06-09T04:38:21.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f972333e700 1 -- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9708004850 msgr2=0x7f9708004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f972333e700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9708004850 0x7f9708004cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f971c0b1170 tx=0x7f9708005880 comp rx=0 tx=0).stop 2023-06-09T04:38:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f972333e700 1 -- 172.21.15.26:0/3475515889 shutdown_connections 2023-06-09T04:38:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f972333e700 1 --2- 172.21.15.26:0/3475515889 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9708004850 0x7f9708004cc0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f971c0b1170 tx=0x7f9708005880 comp rx=0 tx=0).stop 2023-06-09T04:38:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7f972333e700 1 -- 172.21.15.26:0/3475515889 >> 172.21.15.26:0/3475515889 conn(0x7f971c069db0 msgr2=0x7f971c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd34004510 con 0x7fbd440c73e0 2023-06-09T04:38:21.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fbd49c12700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbd2806ace0 0x7fbd2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f972333e700 1 -- 172.21.15.26:0/3475515889 shutdown_connections 2023-06-09T04:38:21.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c380ad490 con 0x7f8c380709c0 2023-06-09T04:38:21.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38144780 con 0x7f8c380709c0 2023-06-09T04:38:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa739d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 0x7fa73c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa73a59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa73c06de50 0x7fa73c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa739d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 0x7fa73c15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48710/0 (socket says 172.21.15.26:48710) 2023-06-09T04:38:21.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa739d9b700 1 -- 172.21.15.26:0/146868338 learned_addr learned my addr 172.21.15.26:0/146868338 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.814+0000 7fa99186a700 1 -- start start 2023-06-09T04:38:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fa99186a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0c2cf0 0x7fa98c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fa99186a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa98c0cc040 0x7fa98c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ef77e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49e806a4c0 0x7f49e80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fa99186a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c1608b0 0x7fa98c0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fa99186a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1fa5c0 con 0x7fa98c1608b0 2023-06-09T04:38:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fa99186a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c15b690 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fa99186a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1f9a40 con 0x7fa98c0cc040 2023-06-09T04:38:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa98a7fc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa98c0cc040 0x7fa98c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ef77e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e806c290 con 0x7f49e80caa40 2023-06-09T04:38:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ef77e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e806c4e0 con 0x7f49e80c8d60 2023-06-09T04:38:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ef77e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e806c7c0 con 0x7f49e806a4c0 2023-06-09T04:38:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7fa98affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0c2cf0 0x7fa98c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.815+0000 7fcf296d1700 1 -- 172.21.15.26:0/563360303 wait complete. 2023-06-09T04:38:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fcf296d1700 1 Processor -- start 2023-06-09T04:38:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.816+0000 7f972333e700 1 -- 172.21.15.26:0/3475515889 wait complete. 2023-06-09T04:38:21.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fbd49c12700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbd2806ace0 0x7fbd2806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd4406f3c0 tx=0x7fbd40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c1608b0 0x7fa98c0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c1608b0 0x7fa98c0c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38046/0 (socket says 172.21.15.26:38046) 2023-06-09T04:38:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa98a7fc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa98c0cc040 0x7fa98c0cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48702/0 (socket says 172.21.15.26:48702) 2023-06-09T04:38:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa98b7fe700 1 -- 172.21.15.26:0/1987719023 learned_addr learned my addr 172.21.15.26:0/1987719023 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ecd19700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49e806a4c0 0x7f49e80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ecd19700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49e806a4c0 0x7f49e80cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45178/0 (socket says 172.21.15.26:45178) 2023-06-09T04:38:21.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7f49ecd19700 1 -- 172.21.15.26:0/455793999 learned_addr learned my addr 172.21.15.26:0/455793999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.817+0000 7fa739d9b700 1 -- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa73c06de50 msgr2=0x7fa73c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa739d9b700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa73c06de50 0x7fa73c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa739d9b700 1 -- 172.21.15.26:0/146868338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 msgr2=0x7fa73c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa739d9b700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 0x7fa73c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa739d9b700 1 -- 172.21.15.26:0/146868338 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009550 con 0x7fa73c0b0190 2023-06-09T04:38:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa98affd700 1 -- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa98c0cc040 msgr2=0x7fa98c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa98affd700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa98c0cc040 0x7fa98c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa98affd700 1 -- 172.21.15.26:0/1987719023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c1608b0 msgr2=0x7fa98c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa98affd700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c1608b0 0x7fa98c0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa98affd700 1 -- 172.21.15.26:0/1987719023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800094a0 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f49ecd19700 1 -- 172.21.15.26:0/455793999 >> v1:172.21.15.104:6789/0 conn(0x7f49e80c8d60 legacy=0x7f49e806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f49ecd19700 1 -- 172.21.15.26:0/455793999 >> v1:172.21.15.26:6789/0 conn(0x7f49e80caa40 legacy=0x7f49e8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c38067180 con 0x7f8c380709c0 2023-06-09T04:38:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f972333e700 1 Processor -- start 2023-06-09T04:38:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f9f28c70700 1 Processor -- start 2023-06-09T04:38:21.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fcf296d1700 1 -- start start 2023-06-09T04:38:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f49ecd19700 1 -- 172.21.15.26:0/455793999 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e806caa0 con 0x7f49e806a4c0 2023-06-09T04:38:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f972333e700 1 -- start start 2023-06-09T04:38:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7fa98affd700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0c2cf0 0x7fa98c15b150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c580 tx=0x7fa97c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f49ecd19700 1 --2- 172.21.15.26:0/455793999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 0x7f49e80cc2e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49d80098f0 tx=0x7f49d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ec722bdcc57a625 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fa739d9b700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 0x7fa73c15e790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa73400efc0 tx=0x7fa73400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.818+0000 7f9f28c70700 1 -- start start 2023-06-09T04:38:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400cdc0 con 0x7fa73c0b0190 2023-06-09T04:38:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400f040 con 0x7fa73c0b0190 2023-06-09T04:38:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c086d70 con 0x7fa73c0b0190 2023-06-09T04:38:21.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf296d1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf240b5930 0x7fcf241f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c087330 con 0x7fa73c0b0190 2023-06-09T04:38:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340146a0 con 0x7fa73c0b0190 2023-06-09T04:38:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f972333e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f971c0ba2e0 0x7f971c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f972333e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971c0c9160 0x7f971c1feff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f972333e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 0x7f971c0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f972333e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0c4870 con 0x7f971c0c9160 2023-06-09T04:38:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f972333e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c169790 con 0x7f971c0ba2e0 2023-06-09T04:38:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f972333e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c16a310 con 0x7f971c1ff530 2023-06-09T04:38:21.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f9f28c70700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240c1a70 0x7f9f241f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f9f28c70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f240cb370 0x7f9f240c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f9f28c70700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240cc8f0 0x7f9f240c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f97218db700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 0x7f971c0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 0x7f971c0c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:48728/0 (socket says 172.21.15.26:48728) 2023-06-09T04:38:21.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 -- 172.21.15.26:0/170469506 learned_addr learned my addr 172.21.15.26:0/170469506 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f9f28c70700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c22e0 con 0x7f9f240cb370 2023-06-09T04:38:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f9f28c70700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c2580 con 0x7f9f240cc8f0 2023-06-09T04:38:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7f9f28c70700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c2860 con 0x7f9f240c1a70 2023-06-09T04:38:21.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97210da700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f971c0ba2e0 0x7f971c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f22d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240cc8f0 0x7f9f240c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f22d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240cc8f0 0x7f9f240c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45198/0 (socket says 172.21.15.26:45198) 2023-06-09T04:38:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f22d9d700 1 -- 172.21.15.26:0/3177872512 learned_addr learned my addr 172.21.15.26:0/3177872512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f2259c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240c1a70 0x7f9f241f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f240cb370 0x7f9f240c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 -- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f971c0ba2e0 msgr2=0x7f971c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f971c0ba2e0 0x7f971c0c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 -- 172.21.15.26:0/170469506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971c0c9160 msgr2=0x7f971c1feff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97208d9700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971c0c9160 0x7f971c1feff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf296d1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 0x7fcf240cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf296d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf2415c440 0x7fcf240cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf296d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2414dcb0 con 0x7fcf2415c440 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf296d1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2414eb10 con 0x7fcf240d0070 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf296d1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf241f6490 con 0x7fcf240b5930 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf227fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 0x7fcf240cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf227fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 0x7fcf240cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45184/0 (socket says 172.21.15.26:45184) 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf227fc700 1 -- 172.21.15.26:0/3659641403 learned_addr learned my addr 172.21.15.26:0/3659641403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.819+0000 7fcf22ffd700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf240b5930 0x7fcf241f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf227fc700 1 -- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf240b5930 msgr2=0x7fcf241f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf227fc700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf240b5930 0x7fcf241f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf227fc700 1 -- 172.21.15.26:0/3659641403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf2415c440 msgr2=0x7fcf240cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf227fc700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf2415c440 0x7fcf240cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf227fc700 1 -- 172.21.15.26:0/3659641403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009b30 con 0x7fcf240d0070 2023-06-09T04:38:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf22ffd700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf240b5930 0x7fcf241f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fcf227fc700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 0x7fcf240cae00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000f80 tx=0x7fcf14004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971c0c9160 0x7f971c1feff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 -- 172.21.15.26:0/170469506 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c1699e0 con 0x7f971c1ff530 2023-06-09T04:38:21.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7200052f0 con 0x7fa73c0b0190 2023-06-09T04:38:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97208d9700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971c0c9160 0x7f971c1feff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f2259c700 1 -- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240cc8f0 msgr2=0x7f9f240c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f2259c700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240cc8f0 0x7f9f240c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f2259c700 1 -- 172.21.15.26:0/3177872512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f240cb370 msgr2=0x7f9f240c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f2259c700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f240cb370 0x7f9f240c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f2259c700 1 -- 172.21.15.26:0/3177872512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14009550 con 0x7f9f240c1a70 2023-06-09T04:38:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f240cb370 0x7f9f240c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.820+0000 7f97218db700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 0x7f971c0c6ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f971c0cd430 tx=0x7f971400a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9f2259c700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240c1a70 0x7f9f241f5c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800e7e0 tx=0x7f9f1800eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400acc0 con 0x7f971c1ff530 2023-06-09T04:38:21.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971400ae20 con 0x7f971c1ff530 2023-06-09T04:38:21.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c169cc0 con 0x7f971c1ff530 2023-06-09T04:38:21.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714013630 con 0x7f971c1ff530 2023-06-09T04:38:21.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa734014800 con 0x7fa73c0b0190 2023-06-09T04:38:21.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800c070 con 0x7f9f240c1a70 2023-06-09T04:38:21.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f18013610 con 0x7f9f240c1a70 2023-06-09T04:38:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18013980 con 0x7f9f240c1a70 2023-06-09T04:38:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240c2b40 con 0x7f9f240c1a70 2023-06-09T04:38:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f241f6150 con 0x7f9f240c1a70 2023-06-09T04:38:21.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c0c95d0 con 0x7f971c1ff530 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c004c80 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c1f9d20 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c1fa2e0 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c067180 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c004de0 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c007310 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd44159c10 con 0x7fbd440c73e0 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f24067270 con 0x7f9f240c1a70 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004310 con 0x7fcf240d0070 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf240c9ee0 con 0x7fcf240d0070 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2414df00 con 0x7fcf240d0070 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14004490 con 0x7fcf240d0070 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004840 con 0x7fcf240d0070 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf080052f0 con 0x7fcf240d0070 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7f49dffff700 1 -- 172.21.15.26:0/455793999 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b8a0 con 0x7f49e806a4c0 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7f49dffff700 1 -- 172.21.15.26:0/455793999 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800ba00 con 0x7f49e806a4c0 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7f49dffff700 1 -- 172.21.15.26:0/455793999 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800bd90 con 0x7f49e806a4c0 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7f49ef77e700 1 -- 172.21.15.26:0/455793999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 msgr2=0x7f49e80cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7f49ef77e700 1 --2- 172.21.15.26:0/455793999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 0x7f49e80cc2e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49d80098f0 tx=0x7f49d8009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f49ef77e700 1 -- 172.21.15.26:0/455793999 shutdown_connections 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f49ef77e700 1 --2- 172.21.15.26:0/455793999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 0x7f49e80cc2e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f49ef77e700 1 -- 172.21.15.26:0/455793999 >> 172.21.15.26:0/455793999 conn(0x7f49e80cbe20 msgr2=0x7f49e80ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f49ef77e700 1 -- 172.21.15.26:0/455793999 shutdown_connections 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f49ef77e700 1 -- 172.21.15.26:0/455793999 wait complete. 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.821+0000 7fa72affd700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa71c06ace0 0x7fa71c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa73408a0b0 con 0x7fa73c0b0190 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7fa73a59c700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa71c06ace0 0x7fa71c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7fa73a59c700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa71c06ace0 0x7fa71c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa730009a10 tx=0x7fa730009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.823+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c34023d50 con 0x7f8c380709c0 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f8c2dffb700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c1c06ad30 0x7f8c1c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c3408f350 con 0x7f8c380709c0 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f8c3d7cd700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c1c06ad30 0x7f8c1c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.825+0000 7f8c3d7cd700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c1c06ad30 0x7f8c1c06d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000f60 tx=0x7f8c28007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.822+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c074080 con 0x7f971c1ff530 2023-06-09T04:38:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.824+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9714013790 con 0x7f971c1ff530 2023-06-09T04:38:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.825+0000 7f9711ffb700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f970006ace0 0x7f970006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.825+0000 7f97210da700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f970006ace0 0x7f970006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.825+0000 7f97210da700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f970006ace0 0x7f970006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f971c069700 tx=0x7f970c013040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.826+0000 7f49ef77e700 1 Processor -- start 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.826+0000 7f49ef77e700 1 -- start start 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f971405ca40 con 0x7f971c1ff530 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ef77e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 0x7f49e815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ef77e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f49e80c8d60 0x7f49e80ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ef77e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 0x7f49e80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ef77e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81511e0 con 0x7f49e80caa40 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ef77e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e815ce70 con 0x7f49e806a4c0 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ef77e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b3a40 con 0x7f49e80c8d60 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 0x7f49e80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 0x7f49e80acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38090/0 (socket says 172.21.15.26:38090) 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 -- 172.21.15.26:0/4107930994 learned_addr learned my addr 172.21.15.26:0/4107930994 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c3405a470 con 0x7f8c380709c0 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49ecd19700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f49e80c8d60 0x7f49e80ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7340550b0 con 0x7fa73c0b0190 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 -- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f49e80c8d60 msgr2=0x7f49e80ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f49e80c8d60 0x7f49e80ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 -- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 msgr2=0x7f49e815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 0x7f49e815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.827+0000 7f49edd1b700 1 -- 172.21.15.26:0/4107930994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009550 con 0x7f49e80caa40 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.828+0000 7f49edd1b700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 0x7f49e80acd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49e000cc50 tx=0x7f49e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0003c00 con 0x7f49e80caa40 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e0003d60 con 0x7f49e80caa40 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000ab60 con 0x7f49e80caa40 2023-06-09T04:38:21.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa97c007470 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80b3d20 con 0x7f49e80caa40 2023-06-09T04:38:21.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80b42e0 con 0x7f49e80caa40 2023-06-09T04:38:21.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.830+0000 7fa973fff700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa97806ace0 0x7fa97806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.830+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa97c089620 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.830+0000 7fa98a7fc700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa97806ace0 0x7fa97806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f18013ae0 con 0x7f9f240c1a70 2023-06-09T04:38:21.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7f9f12ffd700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f0406ace0 0x7f9f0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.830+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f0406ace0 0x7f9f0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.828+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf1402e430 con 0x7fcf240d0070 2023-06-09T04:38:21.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7fcf1b7fe700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf0406ad00 0x7fcf0406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.829+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf1408ab00 con 0x7fcf240d0070 2023-06-09T04:38:21.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.830+0000 7fcf22ffd700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf0406ad00 0x7fcf0406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.830+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c80052f0 con 0x7f49e80caa40 2023-06-09T04:38:21.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.831+0000 7fcf22ffd700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf0406ad00 0x7fcf0406d1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf240b6e00 tx=0x7fcf0c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.831+0000 7fa98a7fc700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa97806ace0 0x7fa97806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa98001d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.831+0000 7f9f21d9b700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f0406ace0 0x7f9f0406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9f14014040 tx=0x7f9f14008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.832+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f1805c2d0 con 0x7f9f240c1a70 2023-06-09T04:38:21.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.832+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49e000acc0 con 0x7f49e80caa40 2023-06-09T04:38:21.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.832+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9714058850 con 0x7f971c1ff530 2023-06-09T04:38:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.832+0000 7f49ddffb700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f49cc06ace0 0x7f49cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.833+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49e0089ec0 con 0x7f49e80caa40 2023-06-09T04:38:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.833+0000 7f49ed51a700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f49cc06ace0 0x7f49cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.833+0000 7f49ed51a700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f49cc06ace0 0x7f49cc06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49e4000f60 tx=0x7f49e4007a60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.837+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f18054650 con 0x7f9f240c1a70 2023-06-09T04:38:21.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.837+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa97c054740 con 0x7fa98c0c2cf0 2023-06-09T04:38:21.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.840+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49e0055050 con 0x7f49e80caa40 2023-06-09T04:38:21.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:21.840+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf14055d20 con 0x7fcf240d0070 2023-06-09T04:38:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.222+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbd44159c10 con 0x7fbd440c73e0 2023-06-09T04:38:22.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.222+0000 7fbd3a7fc700 1 -- 172.21.15.26:0/212666203 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd44159c10 con 0x7fbd440c73e0 2023-06-09T04:38:22.226 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-06-09T04:38:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbd2806ace0 msgr2=0x7fbd2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbd2806ace0 0x7fbd2806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd4406f3c0 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 msgr2=0x7fbd440c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 0x7fbd440c7880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd440ce6a0 tx=0x7fbd3400c670 comp rx=0 tx=0).stop 2023-06-09T04:38:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 shutdown_connections 2023-06-09T04:38:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd440c73e0 0x7fbd440c7880 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbd30004850 0x7fbd4415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbd2806ace0 0x7fbd2806d190 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd4406f3c0 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 --2- 172.21.15.26:0/212666203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd44159ef0 0x7fbd4415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 >> 172.21.15.26:0/212666203 conn(0x7fbd44069db0 msgr2=0x7fbd44156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.226+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 shutdown_connections 2023-06-09T04:38:22.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.227+0000 7fbd4be76700 1 -- 172.21.15.26:0/212666203 wait complete. 2023-06-09T04:38:22.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.238+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c38071cb0 con 0x7f8c380709c0 2023-06-09T04:38:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.239+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa720005870 con 0x7fa73c0b0190 2023-06-09T04:38:22.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.239+0000 7f8c2dffb700 1 -- 172.21.15.26:0/874942016 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c34027090 con 0x7f8c380709c0 2023-06-09T04:38:22.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.243+0000 7fa72affd700 1 -- 172.21.15.26:0/146868338 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa734018090 con 0x7fa73c0b0190 2023-06-09T04:38:22.244 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-06-09T04:38:22.244 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-06-09T04:38:22.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.245+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f971c16a450 con 0x7f971c1ff530 2023-06-09T04:38:22.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa71c06ace0 msgr2=0x7fa71c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7fa740d22700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa71c06ace0 0x7fa71c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa730009a10 tx=0x7fa730009190 comp rx=0 tx=0).stop 2023-06-09T04:38:22.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 msgr2=0x7fa73c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7fa740d22700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 0x7fa73c15e790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa73400efc0 tx=0x7fa73400c3a0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c1c06ad30 msgr2=0x7f8c1c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c1c06ad30 0x7f8c1c06d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000f60 tx=0x7f8c28007a40 comp rx=0 tx=0).stop 2023-06-09T04:38:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 msgr2=0x7f8c381ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.246+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 0x7f8c381ee700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c38159410 tx=0x7f8c34004750 comp rx=0 tx=0).stop 2023-06-09T04:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 shutdown_connections 2023-06-09T04:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c380ae360 0x7f8c38157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c1c06ad30 0x7f8c1c06d1e0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000f60 tx=0x7f8c28007a40 comp rx=0 tx=0).stop 2023-06-09T04:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c3806dc40 0x7f8c38144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 --2- 172.21.15.26:0/874942016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c380709c0 0x7f8c381ee700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 >> 172.21.15.26:0/874942016 conn(0x7f8c380cb9d0 msgr2=0x7f8c3815cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.250 INFO:teuthology.orchestra.run.smithi026.stdout:60129542153 2023-06-09T04:38:22.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2023-06-09T04:38:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 shutdown_connections 2023-06-09T04:38:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa71c06ace0 0x7fa71c06d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c0b0d30 0x7fa73c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa73c06de50 0x7fa73c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 --2- 172.21.15.26:0/146868338 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa73c0b0190 0x7fa73c15e790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f9711ffb700 1 -- 172.21.15.26:0/170469506 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97140583e0 con 0x7f971c1ff530 2023-06-09T04:38:22.252 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 >> 172.21.15.26:0/146868338 conn(0x7fa73c069db0 msgr2=0x7fa73c0cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 shutdown_connections 2023-06-09T04:38:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 shutdown_connections 2023-06-09T04:38:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7fa740d22700 1 -- 172.21.15.26:0/146868338 wait complete. 2023-06-09T04:38:22.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.247+0000 7f8c3fa31700 1 -- 172.21.15.26:0/874942016 wait complete. 2023-06-09T04:38:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.249+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49c8005870 con 0x7f49e80caa40 2023-06-09T04:38:22.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.249+0000 7f49ddffb700 1 -- 172.21.15.26:0/4107930994 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49e0001cb0 con 0x7f49e80caa40 2023-06-09T04:38:22.254 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-06-09T04:38:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.249+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa98c06fbe0 con 0x7fa98c0c2cf0 2023-06-09T04:38:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.250+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f970006ace0 msgr2=0x7f970006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.250+0000 7f972333e700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f970006ace0 0x7f970006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f971c069700 tx=0x7f970c013040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.250+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 msgr2=0x7f971c0c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.250+0000 7f972333e700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 0x7f971c0c6ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f971c0cd430 tx=0x7f971400a5b0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.250+0000 7fa973fff700 1 -- 172.21.15.26:0/1987719023 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa97c007720 con 0x7fa98c0c2cf0 2023-06-09T04:38:22.256 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-06-09T04:38:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.251+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 shutdown_connections 2023-06-09T04:38:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.251+0000 7f972333e700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f971c1ff530 0x7f971c0c6ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.251+0000 7f972333e700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f971c0ba2e0 0x7f971c0c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.251+0000 7f972333e700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f970006ace0 0x7f970006d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.251+0000 7f972333e700 1 --2- 172.21.15.26:0/170469506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f971c0c9160 0x7f971c1feff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.251+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 >> 172.21.15.26:0/170469506 conn(0x7f971c069db0 msgr2=0x7f971c0c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.252+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f49cc06ace0 msgr2=0x7f49cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.252+0000 7f49ef77e700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f49cc06ace0 0x7f49cc06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49e4000f60 tx=0x7f49e4007a60 comp rx=0 tx=0).stop 2023-06-09T04:38:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.252+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 msgr2=0x7f49e80acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.252+0000 7f49ef77e700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 0x7f49e80acd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49e000cc50 tx=0x7f49e000cf60 comp rx=0 tx=0).stop 2023-06-09T04:38:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 shutdown_connections 2023-06-09T04:38:22.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f49ef77e700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f49cc06ace0 0x7f49cc06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f49ef77e700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49e80caa40 0x7f49e80acd50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f49ef77e700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e806a4c0 0x7f49e815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f49ef77e700 1 --2- 172.21.15.26:0/4107930994 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f49e80c8d60 0x7f49e80ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 >> 172.21.15.26:0/4107930994 conn(0x7f49e80cbe20 msgr2=0x7f49e815ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 shutdown_connections 2023-06-09T04:38:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7f972333e700 1 -- 172.21.15.26:0/170469506 wait complete. 2023-06-09T04:38:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa97806ace0 msgr2=0x7fa97806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa97806ace0 0x7fa97806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa98001d040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0c2cf0 msgr2=0x7fa98c15b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0c2cf0 0x7fa98c15b150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c580 tx=0x7fa97c00c890 comp rx=0 tx=0).stop 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 shutdown_connections 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa97806ace0 0x7fa97806d190 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa98001d040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa98c1608b0 0x7fa98c0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa98c0c2cf0 0x7fa98c15b150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 --2- 172.21.15.26:0/1987719023 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa98c0cc040 0x7fa98c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.253+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 >> 172.21.15.26:0/1987719023 conn(0x7fa98c098b50 msgr2=0x7fa98c0cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.255+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 shutdown_connections 2023-06-09T04:38:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.255+0000 7fa99186a700 1 -- 172.21.15.26:0/1987719023 wait complete. 2023-06-09T04:38:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.255+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f24067270 con 0x7f9f240c1a70 2023-06-09T04:38:22.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.256+0000 7f9f12ffd700 1 -- 172.21.15.26:0/3177872512 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f24067270 con 0x7f9f240c1a70 2023-06-09T04:38:22.262 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-06-09T04:38:22.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.260+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f0406ace0 msgr2=0x7f9f0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.260+0000 7f9f28c70700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f0406ace0 0x7f9f0406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9f14014040 tx=0x7f9f14008030 comp rx=0 tx=0).stop 2023-06-09T04:38:22.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.260+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240c1a70 msgr2=0x7f9f241f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.260+0000 7f9f28c70700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240c1a70 0x7f9f241f5c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800e7e0 tx=0x7f9f1800eaf0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.260+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf08005870 con 0x7fcf240d0070 2023-06-09T04:38:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 shutdown_connections 2023-06-09T04:38:22.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240cc8f0 0x7f9f240c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9f240c1a70 0x7f9f241f5c10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f0406ace0 0x7f9f0406d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 --2- 172.21.15.26:0/3177872512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f240cb370 0x7f9f240c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 >> 172.21.15.26:0/3177872512 conn(0x7f9f24069db0 msgr2=0x7f9f240ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 shutdown_connections 2023-06-09T04:38:22.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7f9f28c70700 1 -- 172.21.15.26:0/3177872512 wait complete. 2023-06-09T04:38:22.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.261+0000 7fcf1b7fe700 1 -- 172.21.15.26:0/3659641403 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf1401f020 con 0x7fcf240d0070 2023-06-09T04:38:22.266 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2023-06-09T04:38:22.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.260+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 shutdown_connections 2023-06-09T04:38:22.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.264+0000 7f49ef77e700 1 -- 172.21.15.26:0/4107930994 wait complete. 2023-06-09T04:38:22.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf0406ad00 msgr2=0x7fcf0406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf0406ad00 0x7fcf0406d1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf240b6e00 tx=0x7fcf0c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 msgr2=0x7fcf240cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 0x7fcf240cae00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000f80 tx=0x7fcf14004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 shutdown_connections 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf0406ad00 0x7fcf0406d1b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf2415c440 0x7fcf240cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf240b5930 0x7fcf241f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 --2- 172.21.15.26:0/3659641403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf240d0070 0x7fcf240cae00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 >> 172.21.15.26:0/3659641403 conn(0x7fcf240cf560 msgr2=0x7fcf240d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 shutdown_connections 2023-06-09T04:38:22.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.265+0000 7fcf296d1700 1 -- 172.21.15.26:0/3659641403 wait complete. 2023-06-09T04:38:22.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-06-09T04:38:22.272 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2023-06-09T04:38:22.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-06-09T04:38:22.276 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.276 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2023-06-09T04:38:22.282 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-06-09T04:38:22.285 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-06-09T04:38:22.287 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-06-09T04:38:22.291 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:22.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T04:38:22.291 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.454+0000 7f52d958a700 1 Processor -- start 2023-06-09T04:38:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.454+0000 7f52d958a700 1 -- start start 2023-06-09T04:38:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d958a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f52d4159d00 0x7f52d415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d958a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52d40d1840 0x7f52d40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d958a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d958a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d40ceec0 con 0x7f52d40d1840 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d958a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d40cf400 con 0x7f52d4159d00 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d958a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d415d830 con 0x7f52d40cfdd0 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52d40d1840 0x7f52d40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52d40d1840 0x7f52d40cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38100/0 (socket says 172.21.15.26:38100) 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 -- 172.21.15.26:0/3795536095 learned_addr learned my addr 172.21.15.26:0/3795536095 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d2ffd700 1 --2- 172.21.15.26:0/3795536095 >> v2:172.21.15.104:3300/0 conn(0x7f52d4159d00 0x7f52d415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d37fe700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 -- 172.21.15.26:0/3795536095 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 msgr2=0x7f52d40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 -- 172.21.15.26:0/3795536095 >> v2:172.21.15.104:3300/0 conn(0x7f52d4159d00 msgr2=0x7f52d415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 --2- 172.21.15.26:0/3795536095 >> v2:172.21.15.104:3300/0 conn(0x7f52d4159d00 0x7f52d415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 -- 172.21.15.26:0/3795536095 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40cf0d0 con 0x7f52d40d1840 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d37fe700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:22.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.455+0000 7f52d27fc700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d40cf890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52d408be50 tx=0x7f52c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946c2bc741ae21f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d1ffb700 1 -- 172.21.15.26:0/3795536095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400b870 con 0x7f52d40d1840 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d1ffb700 1 -- 172.21.15.26:0/3795536095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400b9d0 con 0x7f52d40d1840 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d1ffb700 1 -- 172.21.15.26:0/3795536095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400bd60 con 0x7f52d40d1840 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 -- 172.21.15.26:0/3795536095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 msgr2=0x7f52d40cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d40cf890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52d408be50 tx=0x7f52c4009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 -- 172.21.15.26:0/3795536095 shutdown_connections 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 --2- 172.21.15.26:0/3795536095 >> v2:172.21.15.104:3300/0 conn(0x7f52d4159d00 0x7f52d415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 --2- 172.21.15.26:0/3795536095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d40cf890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 -- 172.21.15.26:0/3795536095 >> 172.21.15.26:0/3795536095 conn(0x7f52d40714e0 msgr2=0x7f52d40718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 -- 172.21.15.26:0/3795536095 shutdown_connections 2023-06-09T04:38:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.456+0000 7f52d958a700 1 -- 172.21.15.26:0/3795536095 wait complete. 2023-06-09T04:38:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.457+0000 7f52d958a700 1 Processor -- start 2023-06-09T04:38:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.457+0000 7f52d958a700 1 -- start start 2023-06-09T04:38:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d958a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d4157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d958a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d4157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d958a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d4159d00 0x7f52d40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d958a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4157a60 con 0x7f52d40d1840 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d958a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40b8970 con 0x7f52d4159d00 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d958a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40c9db0 con 0x7f52d40cfdd0 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d4157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d4157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38108/0 (socket says 172.21.15.26:38108) 2023-06-09T04:38:22.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d27fc700 1 -- 172.21.15.26:0/3074598108 learned_addr learned my addr 172.21.15.26:0/3074598108 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d2ffd700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d4157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.458+0000 7f52d37fe700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d4159d00 0x7f52d40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d27fc700 1 -- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 msgr2=0x7f52d4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d27fc700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d4157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d27fc700 1 -- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d4159d00 msgr2=0x7f52d40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d27fc700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d4159d00 0x7f52d40cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d27fc700 1 -- 172.21.15.26:0/3074598108 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009550 con 0x7f52d40d1840 2023-06-09T04:38:22.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d27fc700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d4157520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52c4000c00 tx=0x7f52c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4004480 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c40045e0 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d40ca090 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40038e0 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.459+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d40ca650 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.460+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d4073be0 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.460+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52c4021070 con 0x7f52d40d1840 2023-06-09T04:38:22.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.461+0000 7f52bb7fe700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f52c006ace0 0x7f52c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.461+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52c408a930 con 0x7f52d40d1840 2023-06-09T04:38:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.461+0000 7f52d2ffd700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f52c006ace0 0x7f52c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.461+0000 7f52d2ffd700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f52c006ace0 0x7f52c006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006fd0 tx=0x7f52c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.465+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52c4055a70 con 0x7f52d40d1840 2023-06-09T04:38:22.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.659+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52d40cd6d0 con 0x7f52c006ace0 2023-06-09T04:38:22.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.667+0000 7f52bb7fe700 1 -- 172.21.15.26:0/3074598108 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286868 (secure 0 0 0) 0x7f52c8011750 con 0x7f52c006ace0 2023-06-09T04:38:22.671 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.670+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f52c006ace0 msgr2=0x7f52c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.670+0000 7f52d958a700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f52c006ace0 0x7f52c006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006fd0 tx=0x7f52c8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.670+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 msgr2=0x7f52d4157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.670+0000 7f52d958a700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d4157520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52c4000c00 tx=0x7f52c4004750 comp rx=0 tx=0).stop 2023-06-09T04:38:22.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 shutdown_connections 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d4159d00 0x7f52d40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52d40cfdd0 0x7f52d4157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f52c006ace0 0x7f52c006d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 --2- 172.21.15.26:0/3074598108 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d40d1840 0x7f52d4157520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 >> 172.21.15.26:0/3074598108 conn(0x7f52d40714e0 msgr2=0x7f52d415a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 shutdown_connections 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.671+0000 7f52d958a700 1 -- 172.21.15.26:0/3074598108 wait complete. 2023-06-09T04:38:22.674 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:22.684 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-06-09T04:38:21.876056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1806970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002850"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910608+0000","last_change":"2023-06-09T04:38:10.931316+0000","last_active":"2023-06-09T04:38:11.910608+0000","last_peered":"2023-06-09T04:38:11.910608+0000","last_clean":"2023-06-09T04:38:11.910608+0000","last_became_active":"2023-06-09T04:38:10.930993+0000","last_became_peered":"2023-06-09T04:38:10.930993+0000","last_unstale":"2023-06-09T04:38:11.910608+0000","last_undegraded":"2023-06-09T04:38:11.910608+0000","last_fullsized":"2023-06-09T04:38:11.910608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910788+0000","last_change":"2023-06-09T04:38:10.922601+0000","last_active":"2023-06-09T04:38:11.910788+0000","last_peered":"2023-06-09T04:38:11.910788+0000","last_clean":"2023-06-09T04:38:11.910788+0000","last_became_active":"2023-06-09T04:38:10.922025+0000","last_became_peered":"2023-06-09T04:38:10.922025+0000","last_unstale":"2023-06-09T04:38:11.910788+0000","last_undegraded":"2023-06-09T04:38:11.910788+0000","last_fullsized":"2023-06-09T04:38:11.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412633+0000","last_change":"2023-06-09T04:38:10.931451+0000","last_active":"2023-06-09T04:38:13.412633+0000","last_peered":"2023-06-09T04:38:13.412633+0000","last_clean":"2023-06-09T04:38:13.412633+0000","last_became_active":"2023-06-09T04:38:10.931055+0000","last_became_peered":"2023-06-09T04:38:10.931055+0000","last_unstale":"2023-06-09T04:38:13.412633+0000","last_undegraded":"2023-06-09T04:38:13.412633+0000","last_fullsized":"2023-06-09T04:38:13.412633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910850+0000","last_change":"2023-06-09T04:38:10.922227+0000","last_active":"2023-06-09T04:38:11.910850+0000","last_peered":"2023-06-09T04:38:11.910850+0000","last_clean":"2023-06-09T04:38:11.910850+0000","last_became_active":"2023-06-09T04:38:10.921928+0000","last_became_peered":"2023-06-09T04:38:10.921928+0000","last_unstale":"2023-06-09T04:38:11.910850+0000","last_undegraded":"2023-06-09T04:38:11.910850+0000","last_fullsized":"2023-06-09T04:38:11.910850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391373+0000","last_change":"2023-06-09T04:38:10.925006+0000","last_active":"2023-06-09T04:38:13.391373+0000","last_peered":"2023-06-09T04:38:13.391373+0000","last_clean":"2023-06-09T04:38:13.391373+0000","last_became_active":"2023-06-09T04:38:10.924722+0000","last_became_peered":"2023-06-09T04:38:10.924722+0000","last_unstale":"2023-06-09T04:38:13.391373+0000","last_undegraded":"2023-06-09T04:38:13.391373+0000","last_fullsized":"2023-06-09T04:38:13.391373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909443+0000","last_change":"2023-06-09T04:38:10.930759+0000","last_active":"2023-06-09T04:38:11.909443+0000","last_peered":"2023-06-09T04:38:11.909443+0000","last_clean":"2023-06-09T04:38:11.909443+0000","last_became_active":"2023-06-09T04:38:10.929148+0000","last_became_peered":"2023-06-09T04:38:10.929148+0000","last_unstale":"2023-06-09T04:38:11.909443+0000","last_undegraded":"2023-06-09T04:38:11.909443+0000","last_fullsized":"2023-06-09T04:38:11.909443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910880+0000","last_change":"2023-06-09T04:38:10.931056+0000","last_active":"2023-06-09T04:38:11.910880+0000","last_peered":"2023-06-09T04:38:11.910880+0000","last_clean":"2023-06-09T04:38:11.910880+0000","last_became_active":"2023-06-09T04:38:10.930774+0000","last_became_peered":"2023-06-09T04:38:10.930774+0000","last_unstale":"2023-06-09T04:38:11.910880+0000","last_undegraded":"2023-06-09T04:38:11.910880+0000","last_fullsized":"2023-06-09T04:38:11.910880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910828+0000","last_change":"2023-06-09T04:38:10.921511+0000","last_active":"2023-06-09T04:38:11.910828+0000","last_peered":"2023-06-09T04:38:11.910828+0000","last_clean":"2023-06-09T04:38:11.910828+0000","last_became_active":"2023-06-09T04:38:10.921227+0000","last_became_peered":"2023-06-09T04:38:10.921227+0000","last_unstale":"2023-06-09T04:38:11.910828+0000","last_undegraded":"2023-06-09T04:38:11.910828+0000","last_fullsized":"2023-06-09T04:38:11.910828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909763+0000","last_change":"2023-06-09T04:38:10.929993+0000","last_active":"2023-06-09T04:38:11.909763+0000","last_peered":"2023-06-09T04:38:11.909763+0000","last_clean":"2023-06-09T04:38:11.909763+0000","last_became_active":"2023-06-09T04:38:10.929714+0000","last_became_peered":"2023-06-09T04:38:10.929714+0000","last_unstale":"2023-06-09T04:38:11.909763+0000","last_undegraded":"2023-06-09T04:38:11.909763+0000","last_fullsized":"2023-06-09T04:38:11.909763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391564+0000","last_change":"2023-06-09T04:38:10.925046+0000","last_active":"2023-06-09T04:38:13.391564+0000","last_peered":"2023-06-09T04:38:13.391564+0000","last_clean":"2023-06-09T04:38:13.391564+0000","last_became_active":"2023-06-09T04:38:10.924778+0000","last_became_peered":"2023-06-09T04:38:10.924778+0000","last_unstale":"2023-06-09T04:38:13.391564+0000","last_undegraded":"2023-06-09T04:38:13.391564+0000","last_fullsized":"2023-06-09T04:38:13.391564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910514+0000","last_change":"2023-06-09T04:38:10.922498+0000","last_active":"2023-06-09T04:38:11.910514+0000","last_peered":"2023-06-09T04:38:11.910514+0000","last_clean":"2023-06-09T04:38:11.910514+0000","last_became_active":"2023-06-09T04:38:10.922213+0000","last_became_peered":"2023-06-09T04:38:10.922213+0000","last_unstale":"2023-06-09T04:38:11.910514+0000","last_undegraded":"2023-06-09T04:38:11.910514+0000","last_fullsized":"2023-06-09T04:38:11.910514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911226+0000","last_change":"2023-06-09T04:38:10.915953+0000","last_active":"2023-06-09T04:38:11.911226+0000","last_peered":"2023-06-09T04:38:11.911226+0000","last_clean":"2023-06-09T04:38:11.911226+0000","last_became_active":"2023-06-09T04:38:10.915766+0000","last_became_peered":"2023-06-09T04:38:10.915766+0000","last_unstale":"2023-06-09T04:38:11.911226+0000","last_undegraded":"2023-06-09T04:38:11.911226+0000","last_fullsized":"2023-06-09T04:38:11.911226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911141+0000","last_change":"2023-06-09T04:38:10.933155+0000","last_active":"2023-06-09T04:38:11.911141+0000","last_peered":"2023-06-09T04:38:11.911141+0000","last_clean":"2023-06-09T04:38:11.911141+0000","last_became_active":"2023-06-09T04:38:10.932888+0000","last_became_peered":"2023-06-09T04:38:10.932888+0000","last_unstale":"2023-06-09T04:38:11.911141+0000","last_undegraded":"2023-06-09T04:38:11.911141+0000","last_fullsized":"2023-06-09T04:38:11.911141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391513+0000","last_change":"2023-06-09T04:38:10.932591+0000","last_active":"2023-06-09T04:38:13.391513+0000","last_peered":"2023-06-09T04:38:13.391513+0000","last_clean":"2023-06-09T04:38:13.391513+0000","last_became_active":"2023-06-09T04:38:10.932015+0000","last_became_peered":"2023-06-09T04:38:10.932015+0000","last_unstale":"2023-06-09T04:38:13.391513+0000","last_undegraded":"2023-06-09T04:38:13.391513+0000","last_fullsized":"2023-06-09T04:38:13.391513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391385+0000","last_change":"2023-06-09T04:38:10.931034+0000","last_active":"2023-06-09T04:38:13.391385+0000","last_peered":"2023-06-09T04:38:13.391385+0000","last_clean":"2023-06-09T04:38:13.391385+0000","last_became_active":"2023-06-09T04:38:10.930771+0000","last_became_peered":"2023-06-09T04:38:10.930771+0000","last_unstale":"2023-06-09T04:38:13.391385+0000","last_undegraded":"2023-06-09T04:38:13.391385+0000","last_fullsized":"2023-06-09T04:38:13.391385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909735+0000","last_change":"2023-06-09T04:38:10.934995+0000","last_active":"2023-06-09T04:38:11.909735+0000","last_peered":"2023-06-09T04:38:11.909735+0000","last_clean":"2023-06-09T04:38:11.909735+0000","last_became_active":"2023-06-09T04:38:10.934540+0000","last_became_peered":"2023-06-09T04:38:10.934540+0000","last_unstale":"2023-06-09T04:38:11.909735+0000","last_undegraded":"2023-06-09T04:38:11.909735+0000","last_fullsized":"2023-06-09T04:38:11.909735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911099+0000","last_change":"2023-06-09T04:38:10.504205+0000","last_active":"2023-06-09T04:38:11.911099+0000","last_peered":"2023-06-09T04:38:11.911099+0000","last_clean":"2023-06-09T04:38:11.911099+0000","last_became_active":"2023-06-09T04:38:10.503938+0000","last_became_peered":"2023-06-09T04:38:10.503938+0000","last_unstale":"2023-06-09T04:38:11.911099+0000","last_undegraded":"2023-06-09T04:38:11.911099+0000","last_fullsized":"2023-06-09T04:38:11.911099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412810+0000","last_change":"2023-06-09T04:38:10.931680+0000","last_active":"2023-06-09T04:38:13.412810+0000","last_peered":"2023-06-09T04:38:13.412810+0000","last_clean":"2023-06-09T04:38:13.412810+0000","last_became_active":"2023-06-09T04:38:10.931384+0000","last_became_peered":"2023-06-09T04:38:10.931384+0000","last_unstale":"2023-06-09T04:38:13.412810+0000","last_undegraded":"2023-06-09T04:38:13.412810+0000","last_fullsized":"2023-06-09T04:38:13.412810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910743+0000","last_change":"2023-06-09T04:38:10.504164+0000","last_active":"2023-06-09T04:38:11.910743+0000","last_peered":"2023-06-09T04:38:11.910743+0000","last_clean":"2023-06-09T04:38:11.910743+0000","last_became_active":"2023-06-09T04:38:10.503860+0000","last_became_peered":"2023-06-09T04:38:10.503860+0000","last_unstale":"2023-06-09T04:38:11.910743+0000","last_undegraded":"2023-06-09T04:38:11.910743+0000","last_fullsized":"2023-06-09T04:38:11.910743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391720+0000","last_change":"2023-06-09T04:38:10.503304+0000","last_active":"2023-06-09T04:38:13.391720+0000","last_peered":"2023-06-09T04:38:13.391720+0000","last_clean":"2023-06-09T04:38:13.391720+0000","last_became_active":"2023-06-09T04:38:10.503023+0000","last_became_peered":"2023-06-09T04:38:10.503023+0000","last_unstale":"2023-06-09T04:38:13.391720+0000","last_undegraded":"2023-06-09T04:38:13.391720+0000","last_fullsized":"2023-06-09T04:38:13.391720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:15.493783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911309+0000","last_change":"2023-06-09T04:38:10.506797+0000","last_active":"2023-06-09T04:38:11.911309+0000","last_peered":"2023-06-09T04:38:11.911309+0000","last_clean":"2023-06-09T04:38:11.911309+0000","last_became_active":"2023-06-09T04:38:10.506436+0000","last_became_peered":"2023-06-09T04:38:10.506436+0000","last_unstale":"2023-06-09T04:38:11.911309+0000","last_undegraded":"2023-06-09T04:38:11.911309+0000","last_fullsized":"2023-06-09T04:38:11.911309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:09:17.732730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911246+0000","last_change":"2023-06-09T04:38:10.925785+0000","last_active":"2023-06-09T04:38:11.911246+0000","last_peered":"2023-06-09T04:38:11.911246+0000","last_clean":"2023-06-09T04:38:11.911246+0000","last_became_active":"2023-06-09T04:38:10.925512+0000","last_became_peered":"2023-06-09T04:38:10.925512+0000","last_unstale":"2023-06-09T04:38:11.911246+0000","last_undegraded":"2023-06-09T04:38:11.911246+0000","last_fullsized":"2023-06-09T04:38:11.911246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:31.914046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391558+0000","last_change":"2023-06-09T04:38:10.505311+0000","last_active":"2023-06-09T04:38:13.391558+0000","last_peered":"2023-06-09T04:38:13.391558+0000","last_clean":"2023-06-09T04:38:13.391558+0000","last_became_active":"2023-06-09T04:38:10.505022+0000","last_became_peered":"2023-06-09T04:38:10.505022+0000","last_unstale":"2023-06-09T04:38:13.391558+0000","last_undegraded":"2023-06-09T04:38:13.391558+0000","last_fullsized":"2023-06-09T04:38:13.391558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909893+0000","last_change":"2023-06-09T04:38:10.934791+0000","last_active":"2023-06-09T04:38:11.909893+0000","last_peered":"2023-06-09T04:38:11.909893+0000","last_clean":"2023-06-09T04:38:11.909893+0000","last_became_active":"2023-06-09T04:38:10.934178+0000","last_became_peered":"2023-06-09T04:38:10.934178+0000","last_unstale":"2023-06-09T04:38:11.909893+0000","last_undegraded":"2023-06-09T04:38:11.909893+0000","last_fullsized":"2023-06-09T04:38:11.909893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391381+0000","last_change":"2023-06-09T04:38:10.504977+0000","last_active":"2023-06-09T04:38:13.391381+0000","last_peered":"2023-06-09T04:38:13.391381+0000","last_clean":"2023-06-09T04:38:13.391381+0000","last_became_active":"2023-06-09T04:38:10.504701+0000","last_became_peered":"2023-06-09T04:38:10.504701+0000","last_unstale":"2023-06-09T04:38:13.391381+0000","last_undegraded":"2023-06-09T04:38:13.391381+0000","last_fullsized":"2023-06-09T04:38:13.391381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412380+0000","last_change":"2023-06-09T04:38:10.500330+0000","last_active":"2023-06-09T04:38:13.412380+0000","last_peered":"2023-06-09T04:38:13.412380+0000","last_clean":"2023-06-09T04:38:13.412380+0000","last_became_active":"2023-06-09T04:38:10.500022+0000","last_became_peered":"2023-06-09T04:38:10.500022+0000","last_unstale":"2023-06-09T04:38:13.412380+0000","last_undegraded":"2023-06-09T04:38:13.412380+0000","last_fullsized":"2023-06-09T04:38:13.412380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391817+0000","last_change":"2023-06-09T04:38:10.505087+0000","last_active":"2023-06-09T04:38:13.391817+0000","last_peered":"2023-06-09T04:38:13.391817+0000","last_clean":"2023-06-09T04:38:13.391817+0000","last_became_active":"2023-06-09T04:38:10.504755+0000","last_became_peered":"2023-06-09T04:38:10.504755+0000","last_unstale":"2023-06-09T04:38:13.391817+0000","last_undegraded":"2023-06-09T04:38:13.391817+0000","last_fullsized":"2023-06-09T04:38:13.391817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:39.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909442+0000","last_change":"2023-06-09T04:38:10.929326+0000","last_active":"2023-06-09T04:38:11.909442+0000","last_peered":"2023-06-09T04:38:11.909442+0000","last_clean":"2023-06-09T04:38:11.909442+0000","last_became_active":"2023-06-09T04:38:10.928834+0000","last_became_peered":"2023-06-09T04:38:10.928834+0000","last_unstale":"2023-06-09T04:38:11.909442+0000","last_undegraded":"2023-06-09T04:38:11.909442+0000","last_fullsized":"2023-06-09T04:38:11.909442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391766+0000","last_change":"2023-06-09T04:38:10.506206+0000","last_active":"2023-06-09T04:38:13.391766+0000","last_peered":"2023-06-09T04:38:13.391766+0000","last_clean":"2023-06-09T04:38:13.391766+0000","last_became_active":"2023-06-09T04:38:10.505918+0000","last_became_peered":"2023-06-09T04:38:10.505918+0000","last_unstale":"2023-06-09T04:38:13.391766+0000","last_undegraded":"2023-06-09T04:38:13.391766+0000","last_fullsized":"2023-06-09T04:38:13.391766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:30.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910637+0000","last_change":"2023-06-09T04:38:10.926825+0000","last_active":"2023-06-09T04:38:11.910637+0000","last_peered":"2023-06-09T04:38:11.910637+0000","last_clean":"2023-06-09T04:38:11.910637+0000","last_became_active":"2023-06-09T04:38:10.925259+0000","last_became_peered":"2023-06-09T04:38:10.925259+0000","last_unstale":"2023-06-09T04:38:11.910637+0000","last_undegraded":"2023-06-09T04:38:11.910637+0000","last_fullsized":"2023-06-09T04:38:11.910637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391712+0000","last_change":"2023-06-09T04:38:10.509517+0000","last_active":"2023-06-09T04:38:13.391712+0000","last_peered":"2023-06-09T04:38:13.391712+0000","last_clean":"2023-06-09T04:38:13.391712+0000","last_became_active":"2023-06-09T04:38:10.509176+0000","last_became_peered":"2023-06-09T04:38:10.509176+0000","last_unstale":"2023-06-09T04:38:13.391712+0000","last_undegraded":"2023-06-09T04:38:13.391712+0000","last_fullsized":"2023-06-09T04:38:13.391712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412583+0000","last_change":"2023-06-09T04:38:10.931892+0000","last_active":"2023-06-09T04:38:13.412583+0000","last_peered":"2023-06-09T04:38:13.412583+0000","last_clean":"2023-06-09T04:38:13.412583+0000","last_became_active":"2023-06-09T04:38:10.931582+0000","last_became_peered":"2023-06-09T04:38:10.931582+0000","last_unstale":"2023-06-09T04:38:13.412583+0000","last_undegraded":"2023-06-09T04:38:13.412583+0000","last_fullsized":"2023-06-09T04:38:13.412583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909739+0000","last_change":"2023-06-09T04:38:10.499293+0000","last_active":"2023-06-09T04:38:11.909739+0000","last_peered":"2023-06-09T04:38:11.909739+0000","last_clean":"2023-06-09T04:38:11.909739+0000","last_became_active":"2023-06-09T04:38:10.498975+0000","last_became_peered":"2023-06-09T04:38:10.498975+0000","last_unstale":"2023-06-09T04:38:11.909739+0000","last_undegraded":"2023-06-09T04:38:11.909739+0000","last_fullsized":"2023-06-09T04:38:11.909739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911455+0000","last_change":"2023-06-09T04:38:10.923193+0000","last_active":"2023-06-09T04:38:11.911455+0000","last_peered":"2023-06-09T04:38:11.911455+0000","last_clean":"2023-06-09T04:38:11.911455+0000","last_became_active":"2023-06-09T04:38:10.922990+0000","last_became_peered":"2023-06-09T04:38:10.922990+0000","last_unstale":"2023-06-09T04:38:11.911455+0000","last_undegraded":"2023-06-09T04:38:11.911455+0000","last_fullsized":"2023-06-09T04:38:11.911455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:23:12.547612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412527+0000","last_change":"2023-06-09T04:38:10.505164+0000","last_active":"2023-06-09T04:38:13.412527+0000","last_peered":"2023-06-09T04:38:13.412527+0000","last_clean":"2023-06-09T04:38:13.412527+0000","last_became_active":"2023-06-09T04:38:10.504811+0000","last_became_peered":"2023-06-09T04:38:10.504811+0000","last_unstale":"2023-06-09T04:38:13.412527+0000","last_undegraded":"2023-06-09T04:38:13.412527+0000","last_fullsized":"2023-06-09T04:38:13.412527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911040+0000","last_change":"2023-06-09T04:38:10.920127+0000","last_active":"2023-06-09T04:38:11.911040+0000","last_peered":"2023-06-09T04:38:11.911040+0000","last_clean":"2023-06-09T04:38:11.911040+0000","last_became_active":"2023-06-09T04:38:10.919772+0000","last_became_peered":"2023-06-09T04:38:10.919772+0000","last_unstale":"2023-06-09T04:38:11.911040+0000","last_undegraded":"2023-06-09T04:38:11.911040+0000","last_fullsized":"2023-06-09T04:38:11.911040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911204+0000","last_change":"2023-06-09T04:38:10.501469+0000","last_active":"2023-06-09T04:38:11.911204+0000","last_peered":"2023-06-09T04:38:11.911204+0000","last_clean":"2023-06-09T04:38:11.911204+0000","last_became_active":"2023-06-09T04:38:10.500744+0000","last_became_peered":"2023-06-09T04:38:10.500744+0000","last_unstale":"2023-06-09T04:38:11.911204+0000","last_undegraded":"2023-06-09T04:38:11.911204+0000","last_fullsized":"2023-06-09T04:38:11.911204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911324+0000","last_change":"2023-06-09T04:38:10.929971+0000","last_active":"2023-06-09T04:38:11.911324+0000","last_peered":"2023-06-09T04:38:11.911324+0000","last_clean":"2023-06-09T04:38:11.911324+0000","last_became_active":"2023-06-09T04:38:10.929603+0000","last_became_peered":"2023-06-09T04:38:10.929603+0000","last_unstale":"2023-06-09T04:38:11.911324+0000","last_undegraded":"2023-06-09T04:38:11.911324+0000","last_fullsized":"2023-06-09T04:38:11.911324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:43:02.835123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910907+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:11.910907+0000","last_peered":"2023-06-09T04:38:11.910907+0000","last_clean":"2023-06-09T04:38:11.910907+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:11.910907+0000","last_undegraded":"2023-06-09T04:38:11.910907+0000","last_fullsized":"2023-06-09T04:38:11.910907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:32.018222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.048965+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:13.048965+0000","last_peered":"2023-06-09T04:38:13.048965+0000","last_clean":"2023-06-09T04:38:13.048965+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:13.048965+0000","last_undegraded":"2023-06-09T04:38:13.048965+0000","last_fullsized":"2023-06-09T04:38:13.048965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911059+0000","last_change":"2023-06-09T04:38:10.925917+0000","last_active":"2023-06-09T04:38:11.911059+0000","last_peered":"2023-06-09T04:38:11.911059+0000","last_clean":"2023-06-09T04:38:11.911059+0000","last_became_active":"2023-06-09T04:38:10.925639+0000","last_became_peered":"2023-06-09T04:38:10.925639+0000","last_unstale":"2023-06-09T04:38:11.911059+0000","last_undegraded":"2023-06-09T04:38:11.911059+0000","last_fullsized":"2023-06-09T04:38:11.911059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391469+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:13.391469+0000","last_peered":"2023-06-09T04:38:13.391469+0000","last_clean":"2023-06-09T04:38:13.391469+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:13.391469+0000","last_undegraded":"2023-06-09T04:38:13.391469+0000","last_fullsized":"2023-06-09T04:38:13.391469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:08.271917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391303+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:13.391303+0000","last_peered":"2023-06-09T04:38:13.391303+0000","last_clean":"2023-06-09T04:38:13.391303+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:13.391303+0000","last_undegraded":"2023-06-09T04:38:13.391303+0000","last_fullsized":"2023-06-09T04:38:13.391303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:31.150602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391289+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:13.391289+0000","last_peered":"2023-06-09T04:38:13.391289+0000","last_clean":"2023-06-09T04:38:13.391289+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:13.391289+0000","last_undegraded":"2023-06-09T04:38:13.391289+0000","last_fullsized":"2023-06-09T04:38:13.391289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:02.934690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412689+0000","last_change":"2023-06-09T04:38:10.931667+0000","last_active":"2023-06-09T04:38:13.412689+0000","last_peered":"2023-06-09T04:38:13.412689+0000","last_clean":"2023-06-09T04:38:13.412689+0000","last_became_active":"2023-06-09T04:38:10.931312+0000","last_became_peered":"2023-06-09T04:38:10.931312+0000","last_unstale":"2023-06-09T04:38:13.412689+0000","last_undegraded":"2023-06-09T04:38:13.412689+0000","last_fullsized":"2023-06-09T04:38:13.412689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909605+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:11.909605+0000","last_peered":"2023-06-09T04:38:11.909605+0000","last_clean":"2023-06-09T04:38:11.909605+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:11.909605+0000","last_undegraded":"2023-06-09T04:38:11.909605+0000","last_fullsized":"2023-06-09T04:38:11.909605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:27:59.551499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911066+0000","last_change":"2023-06-09T04:38:10.500644+0000","last_active":"2023-06-09T04:38:11.911066+0000","last_peered":"2023-06-09T04:38:11.911066+0000","last_clean":"2023-06-09T04:38:11.911066+0000","last_became_active":"2023-06-09T04:38:10.500334+0000","last_became_peered":"2023-06-09T04:38:10.500334+0000","last_unstale":"2023-06-09T04:38:11.911066+0000","last_undegraded":"2023-06-09T04:38:11.911066+0000","last_fullsized":"2023-06-09T04:38:11.911066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:03.010329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412714+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:13.412714+0000","last_peered":"2023-06-09T04:38:13.412714+0000","last_clean":"2023-06-09T04:38:13.412714+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:13.412714+0000","last_undegraded":"2023-06-09T04:38:13.412714+0000","last_fullsized":"2023-06-09T04:38:13.412714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:15.845067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412260+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:13.412260+0000","last_peered":"2023-06-09T04:38:13.412260+0000","last_clean":"2023-06-09T04:38:13.412260+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:13.412260+0000","last_undegraded":"2023-06-09T04:38:13.412260+0000","last_fullsized":"2023-06-09T04:38:13.412260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:23.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909967+0000","last_change":"2023-06-09T04:38:10.497932+0000","last_active":"2023-06-09T04:38:11.909967+0000","last_peered":"2023-06-09T04:38:11.909967+0000","last_clean":"2023-06-09T04:38:11.909967+0000","last_became_active":"2023-06-09T04:38:10.497592+0000","last_became_peered":"2023-06-09T04:38:10.497592+0000","last_unstale":"2023-06-09T04:38:11.909967+0000","last_undegraded":"2023-06-09T04:38:11.909967+0000","last_fullsized":"2023-06-09T04:38:11.909967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909546+0000","last_change":"2023-06-09T04:38:10.502062+0000","last_active":"2023-06-09T04:38:11.909546+0000","last_peered":"2023-06-09T04:38:11.909546+0000","last_clean":"2023-06-09T04:38:11.909546+0000","last_became_active":"2023-06-09T04:38:10.501789+0000","last_became_peered":"2023-06-09T04:38:10.501789+0000","last_unstale":"2023-06-09T04:38:11.909546+0000","last_undegraded":"2023-06-09T04:38:11.909546+0000","last_fullsized":"2023-06-09T04:38:11.909546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:45.737873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910961+0000","last_change":"2023-06-09T04:38:10.928386+0000","last_active":"2023-06-09T04:38:11.910961+0000","last_peered":"2023-06-09T04:38:11.910961+0000","last_clean":"2023-06-09T04:38:11.910961+0000","last_became_active":"2023-06-09T04:38:10.928058+0000","last_became_peered":"2023-06-09T04:38:10.928058+0000","last_unstale":"2023-06-09T04:38:11.910961+0000","last_undegraded":"2023-06-09T04:38:11.910961+0000","last_fullsized":"2023-06-09T04:38:11.910961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910058+0000","last_change":"2023-06-09T04:38:10.501766+0000","last_active":"2023-06-09T04:38:11.910058+0000","last_peered":"2023-06-09T04:38:11.910058+0000","last_clean":"2023-06-09T04:38:11.910058+0000","last_became_active":"2023-06-09T04:38:10.501430+0000","last_became_peered":"2023-06-09T04:38:10.501430+0000","last_unstale":"2023-06-09T04:38:11.910058+0000","last_undegraded":"2023-06-09T04:38:11.910058+0000","last_fullsized":"2023-06-09T04:38:11.910058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911284+0000","last_change":"2023-06-09T04:38:10.923112+0000","last_active":"2023-06-09T04:38:11.911284+0000","last_peered":"2023-06-09T04:38:11.911284+0000","last_clean":"2023-06-09T04:38:11.911284+0000","last_became_active":"2023-06-09T04:38:10.922870+0000","last_became_peered":"2023-06-09T04:38:10.922870+0000","last_unstale":"2023-06-09T04:38:11.911284+0000","last_undegraded":"2023-06-09T04:38:11.911284+0000","last_fullsized":"2023-06-09T04:38:11.911284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910580+0000","last_change":"2023-06-09T04:38:10.932621+0000","last_active":"2023-06-09T04:38:11.910580+0000","last_peered":"2023-06-09T04:38:11.910580+0000","last_clean":"2023-06-09T04:38:11.910580+0000","last_became_active":"2023-06-09T04:38:10.932338+0000","last_became_peered":"2023-06-09T04:38:10.932338+0000","last_unstale":"2023-06-09T04:38:11.910580+0000","last_undegraded":"2023-06-09T04:38:11.910580+0000","last_fullsized":"2023-06-09T04:38:11.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412500+0000","last_change":"2023-06-09T04:38:10.924992+0000","last_active":"2023-06-09T04:38:13.412500+0000","last_peered":"2023-06-09T04:38:13.412500+0000","last_clean":"2023-06-09T04:38:13.412500+0000","last_became_active":"2023-06-09T04:38:10.924719+0000","last_became_peered":"2023-06-09T04:38:10.924719+0000","last_unstale":"2023-06-09T04:38:13.412500+0000","last_undegraded":"2023-06-09T04:38:13.412500+0000","last_fullsized":"2023-06-09T04:38:13.412500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911138+0000","last_change":"2023-06-09T04:38:10.933162+0000","last_active":"2023-06-09T04:38:11.911138+0000","last_peered":"2023-06-09T04:38:11.911138+0000","last_clean":"2023-06-09T04:38:11.911138+0000","last_became_active":"2023-06-09T04:38:10.932932+0000","last_became_peered":"2023-06-09T04:38:10.932932+0000","last_unstale":"2023-06-09T04:38:11.911138+0000","last_undegraded":"2023-06-09T04:38:11.911138+0000","last_fullsized":"2023-06-09T04:38:11.911138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":835584,"data_stored":670127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":76818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":79599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":78631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:22.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:22.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.847+0000 7fb9a14a7700 1 Processor -- start 2023-06-09T04:38:22.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.847+0000 7fb9a14a7700 1 -- start start 2023-06-09T04:38:22.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb9a14a7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb9a14a7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c15d950 con 0x7fb99c15d3e0 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb9a14a7700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c0cd360 con 0x7fb99c0cf370 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb9a14a7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0d0970 con 0x7fb99c1569b0 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb99b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb99c15d3e0 0x7fb99c0b7a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46976/0 (socket says 172.21.15.26:46976) 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb99b7fe700 1 -- 172.21.15.26:0/844709624 learned_addr learned my addr 172.21.15.26:0/844709624 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb99affd700 1 --2- 172.21.15.26:0/844709624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460675232 0 0) 0x7fb99c15d950 con 0x7fb99c15d3e0 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9840035b0 con 0x7fb99c15d3e0 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793508281 0 0) 0x7fb99c0cd360 con 0x7fb99c0cf370 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb99c15d950 con 0x7fb99c0cf370 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb99affd700 1 -- 172.21.15.26:0/844709624 >> v1:172.21.15.104:6789/0 conn(0x7fb99c0cf370 legacy=0x7fb99c0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb99affd700 1 -- 172.21.15.26:0/844709624 >> v1:172.21.15.26:6789/0 conn(0x7fb99c15d3e0 legacy=0x7fb99c0b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.848+0000 7fb99affd700 1 -- 172.21.15.26:0/844709624 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c0cd640 con 0x7fb99c1569b0 2023-06-09T04:38:22.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb99affd700 1 --2- 172.21.15.26:0/844709624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0cee30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb990009850 tx=0x7fb990009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc88ea5c4f8486f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990005e30 con 0x7fb99c1569b0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990006030 con 0x7fb99c1569b0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb999ffb700 1 -- 172.21.15.26:0/844709624 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900063a0 con 0x7fb99c1569b0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 -- 172.21.15.26:0/844709624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 msgr2=0x7fb99c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/844709624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0cee30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb990009850 tx=0x7fb990009b60 comp rx=0 tx=0).stop 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 -- 172.21.15.26:0/844709624 shutdown_connections 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/844709624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0cee30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 -- 172.21.15.26:0/844709624 >> 172.21.15.26:0/844709624 conn(0x7fb99c06b1f0 msgr2=0x7fb99c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 -- 172.21.15.26:0/844709624 shutdown_connections 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.849+0000 7fb9a14a7700 1 -- 172.21.15.26:0/844709624 wait complete. 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 Processor -- start 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 -- start start 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 0x7fb99c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb99c15d3e0 0x7fb99c0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1f2c00 con 0x7fb99c0cf370 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1f1cc0 con 0x7fb99c15d3e0 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.851+0000 7fb9a14a7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1f1f80 con 0x7fb99c1569b0 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 0x7fb99c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 0x7fb99c1533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38120/0 (socket says 172.21.15.26:38120) 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 -- 172.21.15.26:0/54311721 learned_addr learned my addr 172.21.15.26:0/54311721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99b7fe700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb99c15d3e0 0x7fb99c0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99a7fc700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 -- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 msgr2=0x7fb99c0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 -- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb99c15d3e0 msgr2=0x7fb99c0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb99c15d3e0 0x7fb99c0c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 -- 172.21.15.26:0/54311721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009430 con 0x7fb99c0cf370 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99b7fe700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb99c15d3e0 0x7fb99c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb99affd700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 0x7fb99c1533a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb990009eb0 tx=0x7fb990004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990004040 con 0x7fb99c0cf370 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990020070 con 0x7fb99c0cf370 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c1f2260 con 0x7fb99c0cf370 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900043c0 con 0x7fb99c0cf370 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.852+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c1f2820 con 0x7fb99c0cf370 2023-06-09T04:38:22.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.853+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c074080 con 0x7fb99c0cf370 2023-06-09T04:38:22.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.854+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb990022030 con 0x7fb99c0cf370 2023-06-09T04:38:22.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.854+0000 7fb9837fe700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb98806ace0 0x7fb98806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.854+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb99008a9a0 con 0x7fb99c0cf370 2023-06-09T04:38:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.854+0000 7fb99a7fc700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb98806ace0 0x7fb98806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.855+0000 7fb99a7fc700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb98806ace0 0x7fb98806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0cf7e0 tx=0x7fb98c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:22.858+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb990055ae0 con 0x7fb99c0cf370 2023-06-09T04:38:23.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.053+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb99c156d80 con 0x7fb98806ace0 2023-06-09T04:38:23.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.062+0000 7fb9837fe700 1 -- 172.21.15.26:0/54311721 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286868 (secure 0 0 0) 0x7fb98c0050d0 con 0x7fb98806ace0 2023-06-09T04:38:23.066 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb98806ace0 msgr2=0x7fb98806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb98806ace0 0x7fb98806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0cf7e0 tx=0x7fb98c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 msgr2=0x7fb99c1533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 0x7fb99c1533a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb990009eb0 tx=0x7fb990004750 comp rx=0 tx=0).stop 2023-06-09T04:38:23.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 shutdown_connections 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb99c15d3e0 0x7fb99c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb98806ace0 0x7fb98806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb99c0cf370 0x7fb99c1533a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 --2- 172.21.15.26:0/54311721 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb99c1569b0 0x7fb99c0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 >> 172.21.15.26:0/54311721 conn(0x7fb99c06b1f0 msgr2=0x7fb99c154570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 shutdown_connections 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.065+0000 7fb9a14a7700 1 -- 172.21.15.26:0/54311721 wait complete. 2023-06-09T04:38:23.069 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:38:23.078 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-06-09T04:38:21.876056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1806970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002850"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912381+0000","last_change":"2023-06-09T04:38:10.922822+0000","last_active":"2023-06-09T04:38:12.912381+0000","last_peered":"2023-06-09T04:38:12.912381+0000","last_clean":"2023-06-09T04:38:12.912381+0000","last_became_active":"2023-06-09T04:38:10.922448+0000","last_became_peered":"2023-06-09T04:38:10.922448+0000","last_unstale":"2023-06-09T04:38:12.912381+0000","last_undegraded":"2023-06-09T04:38:12.912381+0000","last_fullsized":"2023-06-09T04:38:12.912381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:36:12.603763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910608+0000","last_change":"2023-06-09T04:38:10.931316+0000","last_active":"2023-06-09T04:38:11.910608+0000","last_peered":"2023-06-09T04:38:11.910608+0000","last_clean":"2023-06-09T04:38:11.910608+0000","last_became_active":"2023-06-09T04:38:10.930993+0000","last_became_peered":"2023-06-09T04:38:10.930993+0000","last_unstale":"2023-06-09T04:38:11.910608+0000","last_undegraded":"2023-06-09T04:38:11.910608+0000","last_fullsized":"2023-06-09T04:38:11.910608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910788+0000","last_change":"2023-06-09T04:38:10.922601+0000","last_active":"2023-06-09T04:38:11.910788+0000","last_peered":"2023-06-09T04:38:11.910788+0000","last_clean":"2023-06-09T04:38:11.910788+0000","last_became_active":"2023-06-09T04:38:10.922025+0000","last_became_peered":"2023-06-09T04:38:10.922025+0000","last_unstale":"2023-06-09T04:38:11.910788+0000","last_undegraded":"2023-06-09T04:38:11.910788+0000","last_fullsized":"2023-06-09T04:38:11.910788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412633+0000","last_change":"2023-06-09T04:38:10.931451+0000","last_active":"2023-06-09T04:38:13.412633+0000","last_peered":"2023-06-09T04:38:13.412633+0000","last_clean":"2023-06-09T04:38:13.412633+0000","last_became_active":"2023-06-09T04:38:10.931055+0000","last_became_peered":"2023-06-09T04:38:10.931055+0000","last_unstale":"2023-06-09T04:38:13.412633+0000","last_undegraded":"2023-06-09T04:38:13.412633+0000","last_fullsized":"2023-06-09T04:38:13.412633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922599+0000","last_change":"2023-06-09T04:38:10.926890+0000","last_active":"2023-06-09T04:38:12.922599+0000","last_peered":"2023-06-09T04:38:12.922599+0000","last_clean":"2023-06-09T04:38:12.922599+0000","last_became_active":"2023-06-09T04:38:10.926540+0000","last_became_peered":"2023-06-09T04:38:10.926540+0000","last_unstale":"2023-06-09T04:38:12.922599+0000","last_undegraded":"2023-06-09T04:38:12.922599+0000","last_fullsized":"2023-06-09T04:38:12.922599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910850+0000","last_change":"2023-06-09T04:38:10.922227+0000","last_active":"2023-06-09T04:38:11.910850+0000","last_peered":"2023-06-09T04:38:11.910850+0000","last_clean":"2023-06-09T04:38:11.910850+0000","last_became_active":"2023-06-09T04:38:10.921928+0000","last_became_peered":"2023-06-09T04:38:10.921928+0000","last_unstale":"2023-06-09T04:38:11.910850+0000","last_undegraded":"2023-06-09T04:38:11.910850+0000","last_fullsized":"2023-06-09T04:38:11.910850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391373+0000","last_change":"2023-06-09T04:38:10.925006+0000","last_active":"2023-06-09T04:38:13.391373+0000","last_peered":"2023-06-09T04:38:13.391373+0000","last_clean":"2023-06-09T04:38:13.391373+0000","last_became_active":"2023-06-09T04:38:10.924722+0000","last_became_peered":"2023-06-09T04:38:10.924722+0000","last_unstale":"2023-06-09T04:38:13.391373+0000","last_undegraded":"2023-06-09T04:38:13.391373+0000","last_fullsized":"2023-06-09T04:38:13.391373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909443+0000","last_change":"2023-06-09T04:38:10.930759+0000","last_active":"2023-06-09T04:38:11.909443+0000","last_peered":"2023-06-09T04:38:11.909443+0000","last_clean":"2023-06-09T04:38:11.909443+0000","last_became_active":"2023-06-09T04:38:10.929148+0000","last_became_peered":"2023-06-09T04:38:10.929148+0000","last_unstale":"2023-06-09T04:38:11.909443+0000","last_undegraded":"2023-06-09T04:38:11.909443+0000","last_fullsized":"2023-06-09T04:38:11.909443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922717+0000","last_change":"2023-06-09T04:38:10.924625+0000","last_active":"2023-06-09T04:38:12.922717+0000","last_peered":"2023-06-09T04:38:12.922717+0000","last_clean":"2023-06-09T04:38:12.922717+0000","last_became_active":"2023-06-09T04:38:10.924362+0000","last_became_peered":"2023-06-09T04:38:10.924362+0000","last_unstale":"2023-06-09T04:38:12.922717+0000","last_undegraded":"2023-06-09T04:38:12.922717+0000","last_fullsized":"2023-06-09T04:38:12.922717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910880+0000","last_change":"2023-06-09T04:38:10.931056+0000","last_active":"2023-06-09T04:38:11.910880+0000","last_peered":"2023-06-09T04:38:11.910880+0000","last_clean":"2023-06-09T04:38:11.910880+0000","last_became_active":"2023-06-09T04:38:10.930774+0000","last_became_peered":"2023-06-09T04:38:10.930774+0000","last_unstale":"2023-06-09T04:38:11.910880+0000","last_undegraded":"2023-06-09T04:38:11.910880+0000","last_fullsized":"2023-06-09T04:38:11.910880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910828+0000","last_change":"2023-06-09T04:38:10.921511+0000","last_active":"2023-06-09T04:38:11.910828+0000","last_peered":"2023-06-09T04:38:11.910828+0000","last_clean":"2023-06-09T04:38:11.910828+0000","last_became_active":"2023-06-09T04:38:10.921227+0000","last_became_peered":"2023-06-09T04:38:10.921227+0000","last_unstale":"2023-06-09T04:38:11.910828+0000","last_undegraded":"2023-06-09T04:38:11.910828+0000","last_fullsized":"2023-06-09T04:38:11.910828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911846+0000","last_change":"2023-06-09T04:38:10.924404+0000","last_active":"2023-06-09T04:38:12.911846+0000","last_peered":"2023-06-09T04:38:12.911846+0000","last_clean":"2023-06-09T04:38:12.911846+0000","last_became_active":"2023-06-09T04:38:10.924125+0000","last_became_peered":"2023-06-09T04:38:10.924125+0000","last_unstale":"2023-06-09T04:38:12.911846+0000","last_undegraded":"2023-06-09T04:38:12.911846+0000","last_fullsized":"2023-06-09T04:38:12.911846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:20.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.911786+0000","last_change":"2023-06-09T04:38:10.926157+0000","last_active":"2023-06-09T04:38:12.911786+0000","last_peered":"2023-06-09T04:38:12.911786+0000","last_clean":"2023-06-09T04:38:12.911786+0000","last_became_active":"2023-06-09T04:38:10.925883+0000","last_became_peered":"2023-06-09T04:38:10.925883+0000","last_unstale":"2023-06-09T04:38:12.911786+0000","last_undegraded":"2023-06-09T04:38:12.911786+0000","last_fullsized":"2023-06-09T04:38:12.911786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:05.917074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909763+0000","last_change":"2023-06-09T04:38:10.929993+0000","last_active":"2023-06-09T04:38:11.909763+0000","last_peered":"2023-06-09T04:38:11.909763+0000","last_clean":"2023-06-09T04:38:11.909763+0000","last_became_active":"2023-06-09T04:38:10.929714+0000","last_became_peered":"2023-06-09T04:38:10.929714+0000","last_unstale":"2023-06-09T04:38:11.909763+0000","last_undegraded":"2023-06-09T04:38:11.909763+0000","last_fullsized":"2023-06-09T04:38:11.909763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391564+0000","last_change":"2023-06-09T04:38:10.925046+0000","last_active":"2023-06-09T04:38:13.391564+0000","last_peered":"2023-06-09T04:38:13.391564+0000","last_clean":"2023-06-09T04:38:13.391564+0000","last_became_active":"2023-06-09T04:38:10.924778+0000","last_became_peered":"2023-06-09T04:38:10.924778+0000","last_unstale":"2023-06-09T04:38:13.391564+0000","last_undegraded":"2023-06-09T04:38:13.391564+0000","last_fullsized":"2023-06-09T04:38:13.391564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910514+0000","last_change":"2023-06-09T04:38:10.922498+0000","last_active":"2023-06-09T04:38:11.910514+0000","last_peered":"2023-06-09T04:38:11.910514+0000","last_clean":"2023-06-09T04:38:11.910514+0000","last_became_active":"2023-06-09T04:38:10.922213+0000","last_became_peered":"2023-06-09T04:38:10.922213+0000","last_unstale":"2023-06-09T04:38:11.910514+0000","last_undegraded":"2023-06-09T04:38:11.910514+0000","last_fullsized":"2023-06-09T04:38:11.910514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922908+0000","last_change":"2023-06-09T04:38:10.921966+0000","last_active":"2023-06-09T04:38:12.922908+0000","last_peered":"2023-06-09T04:38:12.922908+0000","last_clean":"2023-06-09T04:38:12.922908+0000","last_became_active":"2023-06-09T04:38:10.921626+0000","last_became_peered":"2023-06-09T04:38:10.921626+0000","last_unstale":"2023-06-09T04:38:12.922908+0000","last_undegraded":"2023-06-09T04:38:12.922908+0000","last_fullsized":"2023-06-09T04:38:12.922908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:09.034420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911226+0000","last_change":"2023-06-09T04:38:10.915953+0000","last_active":"2023-06-09T04:38:11.911226+0000","last_peered":"2023-06-09T04:38:11.911226+0000","last_clean":"2023-06-09T04:38:11.911226+0000","last_became_active":"2023-06-09T04:38:10.915766+0000","last_became_peered":"2023-06-09T04:38:10.915766+0000","last_unstale":"2023-06-09T04:38:11.911226+0000","last_undegraded":"2023-06-09T04:38:11.911226+0000","last_fullsized":"2023-06-09T04:38:11.911226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912322+0000","last_change":"2023-06-09T04:38:10.930133+0000","last_active":"2023-06-09T04:38:12.912322+0000","last_peered":"2023-06-09T04:38:12.912322+0000","last_clean":"2023-06-09T04:38:12.912322+0000","last_became_active":"2023-06-09T04:38:10.929786+0000","last_became_peered":"2023-06-09T04:38:10.929786+0000","last_unstale":"2023-06-09T04:38:12.912322+0000","last_undegraded":"2023-06-09T04:38:12.912322+0000","last_fullsized":"2023-06-09T04:38:12.912322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:51:06.366974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911141+0000","last_change":"2023-06-09T04:38:10.933155+0000","last_active":"2023-06-09T04:38:11.911141+0000","last_peered":"2023-06-09T04:38:11.911141+0000","last_clean":"2023-06-09T04:38:11.911141+0000","last_became_active":"2023-06-09T04:38:10.932888+0000","last_became_peered":"2023-06-09T04:38:10.932888+0000","last_unstale":"2023-06-09T04:38:11.911141+0000","last_undegraded":"2023-06-09T04:38:11.911141+0000","last_fullsized":"2023-06-09T04:38:11.911141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:04.865985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391513+0000","last_change":"2023-06-09T04:38:10.932591+0000","last_active":"2023-06-09T04:38:13.391513+0000","last_peered":"2023-06-09T04:38:13.391513+0000","last_clean":"2023-06-09T04:38:13.391513+0000","last_became_active":"2023-06-09T04:38:10.932015+0000","last_became_peered":"2023-06-09T04:38:10.932015+0000","last_unstale":"2023-06-09T04:38:13.391513+0000","last_undegraded":"2023-06-09T04:38:13.391513+0000","last_fullsized":"2023-06-09T04:38:13.391513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922465+0000","last_change":"2023-06-09T04:38:10.916255+0000","last_active":"2023-06-09T04:38:12.922465+0000","last_peered":"2023-06-09T04:38:12.922465+0000","last_clean":"2023-06-09T04:38:12.922465+0000","last_became_active":"2023-06-09T04:38:10.914904+0000","last_became_peered":"2023-06-09T04:38:10.914904+0000","last_unstale":"2023-06-09T04:38:12.922465+0000","last_undegraded":"2023-06-09T04:38:12.922465+0000","last_fullsized":"2023-06-09T04:38:12.922465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:13.240290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196401+0000","last_change":"2023-06-09T04:38:10.923598+0000","last_active":"2023-06-09T04:38:12.196401+0000","last_peered":"2023-06-09T04:38:12.196401+0000","last_clean":"2023-06-09T04:38:12.196401+0000","last_became_active":"2023-06-09T04:38:10.923331+0000","last_became_peered":"2023-06-09T04:38:10.923331+0000","last_unstale":"2023-06-09T04:38:12.196401+0000","last_undegraded":"2023-06-09T04:38:12.196401+0000","last_fullsized":"2023-06-09T04:38:12.196401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391385+0000","last_change":"2023-06-09T04:38:10.931034+0000","last_active":"2023-06-09T04:38:13.391385+0000","last_peered":"2023-06-09T04:38:13.391385+0000","last_clean":"2023-06-09T04:38:13.391385+0000","last_became_active":"2023-06-09T04:38:10.930771+0000","last_became_peered":"2023-06-09T04:38:10.930771+0000","last_unstale":"2023-06-09T04:38:13.391385+0000","last_undegraded":"2023-06-09T04:38:13.391385+0000","last_fullsized":"2023-06-09T04:38:13.391385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908147+0000","last_change":"2023-06-09T04:38:10.929906+0000","last_active":"2023-06-09T04:38:11.908147+0000","last_peered":"2023-06-09T04:38:11.908147+0000","last_clean":"2023-06-09T04:38:11.908147+0000","last_became_active":"2023-06-09T04:38:10.929622+0000","last_became_peered":"2023-06-09T04:38:10.929622+0000","last_unstale":"2023-06-09T04:38:11.908147+0000","last_undegraded":"2023-06-09T04:38:11.908147+0000","last_fullsized":"2023-06-09T04:38:11.908147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908312+0000","last_change":"2023-06-09T04:38:10.916059+0000","last_active":"2023-06-09T04:38:11.908312+0000","last_peered":"2023-06-09T04:38:11.908312+0000","last_clean":"2023-06-09T04:38:11.908312+0000","last_became_active":"2023-06-09T04:38:10.915797+0000","last_became_peered":"2023-06-09T04:38:10.915797+0000","last_unstale":"2023-06-09T04:38:11.908312+0000","last_undegraded":"2023-06-09T04:38:11.908312+0000","last_fullsized":"2023-06-09T04:38:11.908312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909735+0000","last_change":"2023-06-09T04:38:10.934995+0000","last_active":"2023-06-09T04:38:11.909735+0000","last_peered":"2023-06-09T04:38:11.909735+0000","last_clean":"2023-06-09T04:38:11.909735+0000","last_became_active":"2023-06-09T04:38:10.934540+0000","last_became_peered":"2023-06-09T04:38:10.934540+0000","last_unstale":"2023-06-09T04:38:11.909735+0000","last_undegraded":"2023-06-09T04:38:11.909735+0000","last_fullsized":"2023-06-09T04:38:11.909735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911099+0000","last_change":"2023-06-09T04:38:10.504205+0000","last_active":"2023-06-09T04:38:11.911099+0000","last_peered":"2023-06-09T04:38:11.911099+0000","last_clean":"2023-06-09T04:38:11.911099+0000","last_became_active":"2023-06-09T04:38:10.503938+0000","last_became_peered":"2023-06-09T04:38:10.503938+0000","last_unstale":"2023-06-09T04:38:11.911099+0000","last_undegraded":"2023-06-09T04:38:11.911099+0000","last_fullsized":"2023-06-09T04:38:11.911099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196594+0000","last_change":"2023-06-09T04:38:10.921214+0000","last_active":"2023-06-09T04:38:12.196594+0000","last_peered":"2023-06-09T04:38:12.196594+0000","last_clean":"2023-06-09T04:38:12.196594+0000","last_became_active":"2023-06-09T04:38:10.920931+0000","last_became_peered":"2023-06-09T04:38:10.920931+0000","last_unstale":"2023-06-09T04:38:12.196594+0000","last_undegraded":"2023-06-09T04:38:12.196594+0000","last_fullsized":"2023-06-09T04:38:12.196594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:38.117952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908024+0000","last_change":"2023-06-09T04:38:10.503617+0000","last_active":"2023-06-09T04:38:11.908024+0000","last_peered":"2023-06-09T04:38:11.908024+0000","last_clean":"2023-06-09T04:38:11.908024+0000","last_became_active":"2023-06-09T04:38:10.503265+0000","last_became_peered":"2023-06-09T04:38:10.503265+0000","last_unstale":"2023-06-09T04:38:11.908024+0000","last_undegraded":"2023-06-09T04:38:11.908024+0000","last_fullsized":"2023-06-09T04:38:11.908024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.240359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922931+0000","last_change":"2023-06-09T04:38:10.932986+0000","last_active":"2023-06-09T04:38:12.922931+0000","last_peered":"2023-06-09T04:38:12.922931+0000","last_clean":"2023-06-09T04:38:12.922931+0000","last_became_active":"2023-06-09T04:38:10.932679+0000","last_became_peered":"2023-06-09T04:38:10.932679+0000","last_unstale":"2023-06-09T04:38:12.922931+0000","last_undegraded":"2023-06-09T04:38:12.922931+0000","last_fullsized":"2023-06-09T04:38:12.922931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196422+0000","last_change":"2023-06-09T04:38:10.500719+0000","last_active":"2023-06-09T04:38:12.196422+0000","last_peered":"2023-06-09T04:38:12.196422+0000","last_clean":"2023-06-09T04:38:12.196422+0000","last_became_active":"2023-06-09T04:38:10.500387+0000","last_became_peered":"2023-06-09T04:38:10.500387+0000","last_unstale":"2023-06-09T04:38:12.196422+0000","last_undegraded":"2023-06-09T04:38:12.196422+0000","last_fullsized":"2023-06-09T04:38:12.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412810+0000","last_change":"2023-06-09T04:38:10.931680+0000","last_active":"2023-06-09T04:38:13.412810+0000","last_peered":"2023-06-09T04:38:13.412810+0000","last_clean":"2023-06-09T04:38:13.412810+0000","last_became_active":"2023-06-09T04:38:10.931384+0000","last_became_peered":"2023-06-09T04:38:10.931384+0000","last_unstale":"2023-06-09T04:38:13.412810+0000","last_undegraded":"2023-06-09T04:38:13.412810+0000","last_fullsized":"2023-06-09T04:38:13.412810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923007+0000","last_change":"2023-06-09T04:38:10.494347+0000","last_active":"2023-06-09T04:38:12.923007+0000","last_peered":"2023-06-09T04:38:12.923007+0000","last_clean":"2023-06-09T04:38:12.923007+0000","last_became_active":"2023-06-09T04:38:10.493269+0000","last_became_peered":"2023-06-09T04:38:10.493269+0000","last_unstale":"2023-06-09T04:38:12.923007+0000","last_undegraded":"2023-06-09T04:38:12.923007+0000","last_fullsized":"2023-06-09T04:38:12.923007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196351+0000","last_change":"2023-06-09T04:38:10.921955+0000","last_active":"2023-06-09T04:38:12.196351+0000","last_peered":"2023-06-09T04:38:12.196351+0000","last_clean":"2023-06-09T04:38:12.196351+0000","last_became_active":"2023-06-09T04:38:10.921694+0000","last_became_peered":"2023-06-09T04:38:10.921694+0000","last_unstale":"2023-06-09T04:38:12.196351+0000","last_undegraded":"2023-06-09T04:38:12.196351+0000","last_fullsized":"2023-06-09T04:38:12.196351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910743+0000","last_change":"2023-06-09T04:38:10.504164+0000","last_active":"2023-06-09T04:38:11.910743+0000","last_peered":"2023-06-09T04:38:11.910743+0000","last_clean":"2023-06-09T04:38:11.910743+0000","last_became_active":"2023-06-09T04:38:10.503860+0000","last_became_peered":"2023-06-09T04:38:10.503860+0000","last_unstale":"2023-06-09T04:38:11.910743+0000","last_undegraded":"2023-06-09T04:38:11.910743+0000","last_fullsized":"2023-06-09T04:38:11.910743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196717+0000","last_change":"2023-06-09T04:38:10.935511+0000","last_active":"2023-06-09T04:38:12.196717+0000","last_peered":"2023-06-09T04:38:12.196717+0000","last_clean":"2023-06-09T04:38:12.196717+0000","last_became_active":"2023-06-09T04:38:10.935178+0000","last_became_peered":"2023-06-09T04:38:10.935178+0000","last_unstale":"2023-06-09T04:38:12.196717+0000","last_undegraded":"2023-06-09T04:38:12.196717+0000","last_fullsized":"2023-06-09T04:38:12.196717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:16.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391720+0000","last_change":"2023-06-09T04:38:10.503304+0000","last_active":"2023-06-09T04:38:13.391720+0000","last_peered":"2023-06-09T04:38:13.391720+0000","last_clean":"2023-06-09T04:38:13.391720+0000","last_became_active":"2023-06-09T04:38:10.503023+0000","last_became_peered":"2023-06-09T04:38:10.503023+0000","last_unstale":"2023-06-09T04:38:13.391720+0000","last_undegraded":"2023-06-09T04:38:13.391720+0000","last_fullsized":"2023-06-09T04:38:13.391720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:15.493783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908344+0000","last_change":"2023-06-09T04:38:10.930565+0000","last_active":"2023-06-09T04:38:11.908344+0000","last_peered":"2023-06-09T04:38:11.908344+0000","last_clean":"2023-06-09T04:38:11.908344+0000","last_became_active":"2023-06-09T04:38:10.930309+0000","last_became_peered":"2023-06-09T04:38:10.930309+0000","last_unstale":"2023-06-09T04:38:11.908344+0000","last_undegraded":"2023-06-09T04:38:11.908344+0000","last_fullsized":"2023-06-09T04:38:11.908344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911309+0000","last_change":"2023-06-09T04:38:10.506797+0000","last_active":"2023-06-09T04:38:11.911309+0000","last_peered":"2023-06-09T04:38:11.911309+0000","last_clean":"2023-06-09T04:38:11.911309+0000","last_became_active":"2023-06-09T04:38:10.506436+0000","last_became_peered":"2023-06-09T04:38:10.506436+0000","last_unstale":"2023-06-09T04:38:11.911309+0000","last_undegraded":"2023-06-09T04:38:11.911309+0000","last_fullsized":"2023-06-09T04:38:11.911309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:09:17.732730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911246+0000","last_change":"2023-06-09T04:38:10.925785+0000","last_active":"2023-06-09T04:38:11.911246+0000","last_peered":"2023-06-09T04:38:11.911246+0000","last_clean":"2023-06-09T04:38:11.911246+0000","last_became_active":"2023-06-09T04:38:10.925512+0000","last_became_peered":"2023-06-09T04:38:10.925512+0000","last_unstale":"2023-06-09T04:38:11.911246+0000","last_undegraded":"2023-06-09T04:38:11.911246+0000","last_fullsized":"2023-06-09T04:38:11.911246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:31.914046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391558+0000","last_change":"2023-06-09T04:38:10.505311+0000","last_active":"2023-06-09T04:38:13.391558+0000","last_peered":"2023-06-09T04:38:13.391558+0000","last_clean":"2023-06-09T04:38:13.391558+0000","last_became_active":"2023-06-09T04:38:10.505022+0000","last_became_peered":"2023-06-09T04:38:10.505022+0000","last_unstale":"2023-06-09T04:38:13.391558+0000","last_undegraded":"2023-06-09T04:38:13.391558+0000","last_fullsized":"2023-06-09T04:38:13.391558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196664+0000","last_change":"2023-06-09T04:38:10.921398+0000","last_active":"2023-06-09T04:38:12.196664+0000","last_peered":"2023-06-09T04:38:12.196664+0000","last_clean":"2023-06-09T04:38:12.196664+0000","last_became_active":"2023-06-09T04:38:10.921090+0000","last_became_peered":"2023-06-09T04:38:10.921090+0000","last_unstale":"2023-06-09T04:38:12.196664+0000","last_undegraded":"2023-06-09T04:38:12.196664+0000","last_fullsized":"2023-06-09T04:38:12.196664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922700+0000","last_change":"2023-06-09T04:38:10.503558+0000","last_active":"2023-06-09T04:38:12.922700+0000","last_peered":"2023-06-09T04:38:12.922700+0000","last_clean":"2023-06-09T04:38:12.922700+0000","last_became_active":"2023-06-09T04:38:10.503203+0000","last_became_peered":"2023-06-09T04:38:10.503203+0000","last_unstale":"2023-06-09T04:38:12.922700+0000","last_undegraded":"2023-06-09T04:38:12.922700+0000","last_fullsized":"2023-06-09T04:38:12.922700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909893+0000","last_change":"2023-06-09T04:38:10.934791+0000","last_active":"2023-06-09T04:38:11.909893+0000","last_peered":"2023-06-09T04:38:11.909893+0000","last_clean":"2023-06-09T04:38:11.909893+0000","last_became_active":"2023-06-09T04:38:10.934178+0000","last_became_peered":"2023-06-09T04:38:10.934178+0000","last_unstale":"2023-06-09T04:38:11.909893+0000","last_undegraded":"2023-06-09T04:38:11.909893+0000","last_fullsized":"2023-06-09T04:38:11.909893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391381+0000","last_change":"2023-06-09T04:38:10.504977+0000","last_active":"2023-06-09T04:38:13.391381+0000","last_peered":"2023-06-09T04:38:13.391381+0000","last_clean":"2023-06-09T04:38:13.391381+0000","last_became_active":"2023-06-09T04:38:10.504701+0000","last_became_peered":"2023-06-09T04:38:10.504701+0000","last_unstale":"2023-06-09T04:38:13.391381+0000","last_undegraded":"2023-06-09T04:38:13.391381+0000","last_fullsized":"2023-06-09T04:38:13.391381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:37.112757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922666+0000","last_change":"2023-06-09T04:38:10.924218+0000","last_active":"2023-06-09T04:38:12.922666+0000","last_peered":"2023-06-09T04:38:12.922666+0000","last_clean":"2023-06-09T04:38:12.922666+0000","last_became_active":"2023-06-09T04:38:10.923936+0000","last_became_peered":"2023-06-09T04:38:10.923936+0000","last_unstale":"2023-06-09T04:38:12.922666+0000","last_undegraded":"2023-06-09T04:38:12.922666+0000","last_fullsized":"2023-06-09T04:38:12.922666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412380+0000","last_change":"2023-06-09T04:38:10.500330+0000","last_active":"2023-06-09T04:38:13.412380+0000","last_peered":"2023-06-09T04:38:13.412380+0000","last_clean":"2023-06-09T04:38:13.412380+0000","last_became_active":"2023-06-09T04:38:10.500022+0000","last_became_peered":"2023-06-09T04:38:10.500022+0000","last_unstale":"2023-06-09T04:38:13.412380+0000","last_undegraded":"2023-06-09T04:38:13.412380+0000","last_fullsized":"2023-06-09T04:38:13.412380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196838+0000","last_change":"2023-06-09T04:38:10.929213+0000","last_active":"2023-06-09T04:38:12.196838+0000","last_peered":"2023-06-09T04:38:12.196838+0000","last_clean":"2023-06-09T04:38:12.196838+0000","last_became_active":"2023-06-09T04:38:10.928943+0000","last_became_peered":"2023-06-09T04:38:10.928943+0000","last_unstale":"2023-06-09T04:38:12.196838+0000","last_undegraded":"2023-06-09T04:38:12.196838+0000","last_fullsized":"2023-06-09T04:38:12.196838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391817+0000","last_change":"2023-06-09T04:38:10.505087+0000","last_active":"2023-06-09T04:38:13.391817+0000","last_peered":"2023-06-09T04:38:13.391817+0000","last_clean":"2023-06-09T04:38:13.391817+0000","last_became_active":"2023-06-09T04:38:10.504755+0000","last_became_peered":"2023-06-09T04:38:10.504755+0000","last_unstale":"2023-06-09T04:38:13.391817+0000","last_undegraded":"2023-06-09T04:38:13.391817+0000","last_fullsized":"2023-06-09T04:38:13.391817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:39.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909442+0000","last_change":"2023-06-09T04:38:10.929326+0000","last_active":"2023-06-09T04:38:11.909442+0000","last_peered":"2023-06-09T04:38:11.909442+0000","last_clean":"2023-06-09T04:38:11.909442+0000","last_became_active":"2023-06-09T04:38:10.928834+0000","last_became_peered":"2023-06-09T04:38:10.928834+0000","last_unstale":"2023-06-09T04:38:11.909442+0000","last_undegraded":"2023-06-09T04:38:11.909442+0000","last_fullsized":"2023-06-09T04:38:11.909442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391766+0000","last_change":"2023-06-09T04:38:10.506206+0000","last_active":"2023-06-09T04:38:13.391766+0000","last_peered":"2023-06-09T04:38:13.391766+0000","last_clean":"2023-06-09T04:38:13.391766+0000","last_became_active":"2023-06-09T04:38:10.505918+0000","last_became_peered":"2023-06-09T04:38:10.505918+0000","last_unstale":"2023-06-09T04:38:13.391766+0000","last_undegraded":"2023-06-09T04:38:13.391766+0000","last_fullsized":"2023-06-09T04:38:13.391766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:30.908851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910637+0000","last_change":"2023-06-09T04:38:10.926825+0000","last_active":"2023-06-09T04:38:11.910637+0000","last_peered":"2023-06-09T04:38:11.910637+0000","last_clean":"2023-06-09T04:38:11.910637+0000","last_became_active":"2023-06-09T04:38:10.925259+0000","last_became_peered":"2023-06-09T04:38:10.925259+0000","last_unstale":"2023-06-09T04:38:11.910637+0000","last_undegraded":"2023-06-09T04:38:11.910637+0000","last_fullsized":"2023-06-09T04:38:11.910637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391712+0000","last_change":"2023-06-09T04:38:10.509517+0000","last_active":"2023-06-09T04:38:13.391712+0000","last_peered":"2023-06-09T04:38:13.391712+0000","last_clean":"2023-06-09T04:38:13.391712+0000","last_became_active":"2023-06-09T04:38:10.509176+0000","last_became_peered":"2023-06-09T04:38:10.509176+0000","last_unstale":"2023-06-09T04:38:13.391712+0000","last_undegraded":"2023-06-09T04:38:13.391712+0000","last_fullsized":"2023-06-09T04:38:13.391712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412583+0000","last_change":"2023-06-09T04:38:10.931892+0000","last_active":"2023-06-09T04:38:13.412583+0000","last_peered":"2023-06-09T04:38:13.412583+0000","last_clean":"2023-06-09T04:38:13.412583+0000","last_became_active":"2023-06-09T04:38:10.931582+0000","last_became_peered":"2023-06-09T04:38:10.931582+0000","last_unstale":"2023-06-09T04:38:13.412583+0000","last_undegraded":"2023-06-09T04:38:13.412583+0000","last_fullsized":"2023-06-09T04:38:13.412583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909739+0000","last_change":"2023-06-09T04:38:10.499293+0000","last_active":"2023-06-09T04:38:11.909739+0000","last_peered":"2023-06-09T04:38:11.909739+0000","last_clean":"2023-06-09T04:38:11.909739+0000","last_became_active":"2023-06-09T04:38:10.498975+0000","last_became_peered":"2023-06-09T04:38:10.498975+0000","last_unstale":"2023-06-09T04:38:11.909739+0000","last_undegraded":"2023-06-09T04:38:11.909739+0000","last_fullsized":"2023-06-09T04:38:11.909739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:20.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922433+0000","last_change":"2023-06-09T04:38:10.921713+0000","last_active":"2023-06-09T04:38:12.922433+0000","last_peered":"2023-06-09T04:38:12.922433+0000","last_clean":"2023-06-09T04:38:12.922433+0000","last_became_active":"2023-06-09T04:38:10.921454+0000","last_became_peered":"2023-06-09T04:38:10.921454+0000","last_unstale":"2023-06-09T04:38:12.922433+0000","last_undegraded":"2023-06-09T04:38:12.922433+0000","last_fullsized":"2023-06-09T04:38:12.922433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196761+0000","last_change":"2023-06-09T04:38:10.500853+0000","last_active":"2023-06-09T04:38:12.196761+0000","last_peered":"2023-06-09T04:38:12.196761+0000","last_clean":"2023-06-09T04:38:12.196761+0000","last_became_active":"2023-06-09T04:38:10.500529+0000","last_became_peered":"2023-06-09T04:38:10.500529+0000","last_unstale":"2023-06-09T04:38:12.196761+0000","last_undegraded":"2023-06-09T04:38:12.196761+0000","last_fullsized":"2023-06-09T04:38:12.196761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:37:32.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911455+0000","last_change":"2023-06-09T04:38:10.923193+0000","last_active":"2023-06-09T04:38:11.911455+0000","last_peered":"2023-06-09T04:38:11.911455+0000","last_clean":"2023-06-09T04:38:11.911455+0000","last_became_active":"2023-06-09T04:38:10.922990+0000","last_became_peered":"2023-06-09T04:38:10.922990+0000","last_unstale":"2023-06-09T04:38:11.911455+0000","last_undegraded":"2023-06-09T04:38:11.911455+0000","last_fullsized":"2023-06-09T04:38:11.911455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:23:12.547612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412527+0000","last_change":"2023-06-09T04:38:10.505164+0000","last_active":"2023-06-09T04:38:13.412527+0000","last_peered":"2023-06-09T04:38:13.412527+0000","last_clean":"2023-06-09T04:38:13.412527+0000","last_became_active":"2023-06-09T04:38:10.504811+0000","last_became_peered":"2023-06-09T04:38:10.504811+0000","last_unstale":"2023-06-09T04:38:13.412527+0000","last_undegraded":"2023-06-09T04:38:13.412527+0000","last_fullsized":"2023-06-09T04:38:13.412527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911040+0000","last_change":"2023-06-09T04:38:10.920127+0000","last_active":"2023-06-09T04:38:11.911040+0000","last_peered":"2023-06-09T04:38:11.911040+0000","last_clean":"2023-06-09T04:38:11.911040+0000","last_became_active":"2023-06-09T04:38:10.919772+0000","last_became_peered":"2023-06-09T04:38:10.919772+0000","last_unstale":"2023-06-09T04:38:11.911040+0000","last_undegraded":"2023-06-09T04:38:11.911040+0000","last_fullsized":"2023-06-09T04:38:11.911040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911204+0000","last_change":"2023-06-09T04:38:10.501469+0000","last_active":"2023-06-09T04:38:11.911204+0000","last_peered":"2023-06-09T04:38:11.911204+0000","last_clean":"2023-06-09T04:38:11.911204+0000","last_became_active":"2023-06-09T04:38:10.500744+0000","last_became_peered":"2023-06-09T04:38:10.500744+0000","last_unstale":"2023-06-09T04:38:11.911204+0000","last_undegraded":"2023-06-09T04:38:11.911204+0000","last_fullsized":"2023-06-09T04:38:11.911204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911324+0000","last_change":"2023-06-09T04:38:10.929971+0000","last_active":"2023-06-09T04:38:11.911324+0000","last_peered":"2023-06-09T04:38:11.911324+0000","last_clean":"2023-06-09T04:38:11.911324+0000","last_became_active":"2023-06-09T04:38:10.929603+0000","last_became_peered":"2023-06-09T04:38:10.929603+0000","last_unstale":"2023-06-09T04:38:11.911324+0000","last_undegraded":"2023-06-09T04:38:11.911324+0000","last_fullsized":"2023-06-09T04:38:11.911324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:43:02.835123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196266+0000","last_change":"2023-06-09T04:38:10.501956+0000","last_active":"2023-06-09T04:38:12.196266+0000","last_peered":"2023-06-09T04:38:12.196266+0000","last_clean":"2023-06-09T04:38:12.196266+0000","last_became_active":"2023-06-09T04:38:10.501622+0000","last_became_peered":"2023-06-09T04:38:10.501622+0000","last_unstale":"2023-06-09T04:38:12.196266+0000","last_undegraded":"2023-06-09T04:38:12.196266+0000","last_fullsized":"2023-06-09T04:38:12.196266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908369+0000","last_change":"2023-06-09T04:38:10.923395+0000","last_active":"2023-06-09T04:38:11.908369+0000","last_peered":"2023-06-09T04:38:11.908369+0000","last_clean":"2023-06-09T04:38:11.908369+0000","last_became_active":"2023-06-09T04:38:10.923135+0000","last_became_peered":"2023-06-09T04:38:10.923135+0000","last_unstale":"2023-06-09T04:38:11.908369+0000","last_undegraded":"2023-06-09T04:38:11.908369+0000","last_fullsized":"2023-06-09T04:38:11.908369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:13.346614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196697+0000","last_change":"2023-06-09T04:38:10.504273+0000","last_active":"2023-06-09T04:38:12.196697+0000","last_peered":"2023-06-09T04:38:12.196697+0000","last_clean":"2023-06-09T04:38:12.196697+0000","last_became_active":"2023-06-09T04:38:10.503946+0000","last_became_peered":"2023-06-09T04:38:10.503946+0000","last_unstale":"2023-06-09T04:38:12.196697+0000","last_undegraded":"2023-06-09T04:38:12.196697+0000","last_fullsized":"2023-06-09T04:38:12.196697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:28.443919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910907+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:38:11.910907+0000","last_peered":"2023-06-09T04:38:11.910907+0000","last_clean":"2023-06-09T04:38:11.910907+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:38:11.910907+0000","last_undegraded":"2023-06-09T04:38:11.910907+0000","last_fullsized":"2023-06-09T04:38:11.910907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:32.018222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196189+0000","last_change":"2023-06-09T04:38:10.928598+0000","last_active":"2023-06-09T04:38:12.196189+0000","last_peered":"2023-06-09T04:38:12.196189+0000","last_clean":"2023-06-09T04:38:12.196189+0000","last_became_active":"2023-06-09T04:38:10.928274+0000","last_became_peered":"2023-06-09T04:38:10.928274+0000","last_unstale":"2023-06-09T04:38:12.196189+0000","last_undegraded":"2023-06-09T04:38:12.196189+0000","last_fullsized":"2023-06-09T04:38:12.196189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196690+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:38:12.196690+0000","last_peered":"2023-06-09T04:38:12.196690+0000","last_clean":"2023-06-09T04:38:12.196690+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:38:12.196690+0000","last_undegraded":"2023-06-09T04:38:12.196690+0000","last_fullsized":"2023-06-09T04:38:12.196690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:25.814316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.048965+0000","last_change":"2023-06-09T04:38:10.497669+0000","last_active":"2023-06-09T04:38:13.048965+0000","last_peered":"2023-06-09T04:38:13.048965+0000","last_clean":"2023-06-09T04:38:13.048965+0000","last_became_active":"2023-06-09T04:38:10.497237+0000","last_became_peered":"2023-06-09T04:38:10.497237+0000","last_unstale":"2023-06-09T04:38:13.048965+0000","last_undegraded":"2023-06-09T04:38:13.048965+0000","last_fullsized":"2023-06-09T04:38:13.048965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:03.903441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911059+0000","last_change":"2023-06-09T04:38:10.925917+0000","last_active":"2023-06-09T04:38:11.911059+0000","last_peered":"2023-06-09T04:38:11.911059+0000","last_clean":"2023-06-09T04:38:11.911059+0000","last_became_active":"2023-06-09T04:38:10.925639+0000","last_became_peered":"2023-06-09T04:38:10.925639+0000","last_unstale":"2023-06-09T04:38:11.911059+0000","last_undegraded":"2023-06-09T04:38:11.911059+0000","last_fullsized":"2023-06-09T04:38:11.911059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:04.908636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.907968+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:38:11.907968+0000","last_peered":"2023-06-09T04:38:11.907968+0000","last_clean":"2023-06-09T04:38:11.907968+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:38:11.907968+0000","last_undegraded":"2023-06-09T04:38:11.907968+0000","last_fullsized":"2023-06-09T04:38:11.907968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:21.638890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391469+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:38:13.391469+0000","last_peered":"2023-06-09T04:38:13.391469+0000","last_clean":"2023-06-09T04:38:13.391469+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:38:13.391469+0000","last_undegraded":"2023-06-09T04:38:13.391469+0000","last_fullsized":"2023-06-09T04:38:13.391469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:08.271917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922439+0000","last_change":"2023-06-09T04:38:10.499330+0000","last_active":"2023-06-09T04:38:12.922439+0000","last_peered":"2023-06-09T04:38:12.922439+0000","last_clean":"2023-06-09T04:38:12.922439+0000","last_became_active":"2023-06-09T04:38:10.498947+0000","last_became_peered":"2023-06-09T04:38:10.498947+0000","last_unstale":"2023-06-09T04:38:12.922439+0000","last_undegraded":"2023-06-09T04:38:12.922439+0000","last_fullsized":"2023-06-09T04:38:12.922439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:31:26.733425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922818+0000","last_change":"2023-06-09T04:38:10.918121+0000","last_active":"2023-06-09T04:38:12.922818+0000","last_peered":"2023-06-09T04:38:12.922818+0000","last_clean":"2023-06-09T04:38:12.922818+0000","last_became_active":"2023-06-09T04:38:10.917865+0000","last_became_peered":"2023-06-09T04:38:10.917865+0000","last_unstale":"2023-06-09T04:38:12.922818+0000","last_undegraded":"2023-06-09T04:38:12.922818+0000","last_fullsized":"2023-06-09T04:38:12.922818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391303+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:38:13.391303+0000","last_peered":"2023-06-09T04:38:13.391303+0000","last_clean":"2023-06-09T04:38:13.391303+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:38:13.391303+0000","last_undegraded":"2023-06-09T04:38:13.391303+0000","last_fullsized":"2023-06-09T04:38:13.391303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:31.150602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908479+0000","last_change":"2023-06-09T04:38:10.495431+0000","last_active":"2023-06-09T04:38:11.908479+0000","last_peered":"2023-06-09T04:38:11.908479+0000","last_clean":"2023-06-09T04:38:11.908479+0000","last_became_active":"2023-06-09T04:38:10.495134+0000","last_became_peered":"2023-06-09T04:38:10.495134+0000","last_unstale":"2023-06-09T04:38:11.908479+0000","last_undegraded":"2023-06-09T04:38:11.908479+0000","last_fullsized":"2023-06-09T04:38:11.908479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908327+0000","last_change":"2023-06-09T04:38:10.919335+0000","last_active":"2023-06-09T04:38:11.908327+0000","last_peered":"2023-06-09T04:38:11.908327+0000","last_clean":"2023-06-09T04:38:11.908327+0000","last_became_active":"2023-06-09T04:38:10.919050+0000","last_became_peered":"2023-06-09T04:38:10.919050+0000","last_unstale":"2023-06-09T04:38:11.908327+0000","last_undegraded":"2023-06-09T04:38:11.908327+0000","last_fullsized":"2023-06-09T04:38:11.908327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.391289+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:38:13.391289+0000","last_peered":"2023-06-09T04:38:13.391289+0000","last_clean":"2023-06-09T04:38:13.391289+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:38:13.391289+0000","last_undegraded":"2023-06-09T04:38:13.391289+0000","last_fullsized":"2023-06-09T04:38:13.391289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:02.934690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196354+0000","last_change":"2023-06-09T04:38:10.502265+0000","last_active":"2023-06-09T04:38:12.196354+0000","last_peered":"2023-06-09T04:38:12.196354+0000","last_clean":"2023-06-09T04:38:12.196354+0000","last_became_active":"2023-06-09T04:38:10.501988+0000","last_became_peered":"2023-06-09T04:38:10.501988+0000","last_unstale":"2023-06-09T04:38:12.196354+0000","last_undegraded":"2023-06-09T04:38:12.196354+0000","last_fullsized":"2023-06-09T04:38:12.196354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412689+0000","last_change":"2023-06-09T04:38:10.931667+0000","last_active":"2023-06-09T04:38:13.412689+0000","last_peered":"2023-06-09T04:38:13.412689+0000","last_clean":"2023-06-09T04:38:13.412689+0000","last_became_active":"2023-06-09T04:38:10.931312+0000","last_became_peered":"2023-06-09T04:38:10.931312+0000","last_unstale":"2023-06-09T04:38:13.412689+0000","last_undegraded":"2023-06-09T04:38:13.412689+0000","last_fullsized":"2023-06-09T04:38:13.412689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:13.002897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909605+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:38:11.909605+0000","last_peered":"2023-06-09T04:38:11.909605+0000","last_clean":"2023-06-09T04:38:11.909605+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:38:11.909605+0000","last_undegraded":"2023-06-09T04:38:11.909605+0000","last_fullsized":"2023-06-09T04:38:11.909605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:27:59.551499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911066+0000","last_change":"2023-06-09T04:38:10.500644+0000","last_active":"2023-06-09T04:38:11.911066+0000","last_peered":"2023-06-09T04:38:11.911066+0000","last_clean":"2023-06-09T04:38:11.911066+0000","last_became_active":"2023-06-09T04:38:10.500334+0000","last_became_peered":"2023-06-09T04:38:10.500334+0000","last_unstale":"2023-06-09T04:38:11.911066+0000","last_undegraded":"2023-06-09T04:38:11.911066+0000","last_fullsized":"2023-06-09T04:38:11.911066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:03.010329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908401+0000","last_change":"2023-06-09T04:38:10.914533+0000","last_active":"2023-06-09T04:38:11.908401+0000","last_peered":"2023-06-09T04:38:11.908401+0000","last_clean":"2023-06-09T04:38:11.908401+0000","last_became_active":"2023-06-09T04:38:10.913642+0000","last_became_peered":"2023-06-09T04:38:10.913642+0000","last_unstale":"2023-06-09T04:38:11.908401+0000","last_undegraded":"2023-06-09T04:38:11.908401+0000","last_fullsized":"2023-06-09T04:38:11.908401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:40.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412714+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:38:13.412714+0000","last_peered":"2023-06-09T04:38:13.412714+0000","last_clean":"2023-06-09T04:38:13.412714+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:38:13.412714+0000","last_undegraded":"2023-06-09T04:38:13.412714+0000","last_fullsized":"2023-06-09T04:38:13.412714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:15.845067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908151+0000","last_change":"2023-06-09T04:38:10.495525+0000","last_active":"2023-06-09T04:38:11.908151+0000","last_peered":"2023-06-09T04:38:11.908151+0000","last_clean":"2023-06-09T04:38:11.908151+0000","last_became_active":"2023-06-09T04:38:10.495205+0000","last_became_peered":"2023-06-09T04:38:10.495205+0000","last_unstale":"2023-06-09T04:38:11.908151+0000","last_undegraded":"2023-06-09T04:38:11.908151+0000","last_fullsized":"2023-06-09T04:38:11.908151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:12.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922909+0000","last_change":"2023-06-09T04:38:10.932843+0000","last_active":"2023-06-09T04:38:12.922909+0000","last_peered":"2023-06-09T04:38:12.922909+0000","last_clean":"2023-06-09T04:38:12.922909+0000","last_became_active":"2023-06-09T04:38:10.932531+0000","last_became_peered":"2023-06-09T04:38:10.932531+0000","last_unstale":"2023-06-09T04:38:12.922909+0000","last_undegraded":"2023-06-09T04:38:12.922909+0000","last_fullsized":"2023-06-09T04:38:12.922909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412260+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:38:13.412260+0000","last_peered":"2023-06-09T04:38:13.412260+0000","last_clean":"2023-06-09T04:38:13.412260+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:38:13.412260+0000","last_undegraded":"2023-06-09T04:38:13.412260+0000","last_fullsized":"2023-06-09T04:38:13.412260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:23.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909967+0000","last_change":"2023-06-09T04:38:10.497932+0000","last_active":"2023-06-09T04:38:11.909967+0000","last_peered":"2023-06-09T04:38:11.909967+0000","last_clean":"2023-06-09T04:38:11.909967+0000","last_became_active":"2023-06-09T04:38:10.497592+0000","last_became_peered":"2023-06-09T04:38:10.497592+0000","last_unstale":"2023-06-09T04:38:11.909967+0000","last_undegraded":"2023-06-09T04:38:11.909967+0000","last_fullsized":"2023-06-09T04:38:11.909967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.935016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908192+0000","last_change":"2023-06-09T04:38:10.930697+0000","last_active":"2023-06-09T04:38:11.908192+0000","last_peered":"2023-06-09T04:38:11.908192+0000","last_clean":"2023-06-09T04:38:11.908192+0000","last_became_active":"2023-06-09T04:38:10.930415+0000","last_became_peered":"2023-06-09T04:38:10.930415+0000","last_unstale":"2023-06-09T04:38:11.908192+0000","last_undegraded":"2023-06-09T04:38:11.908192+0000","last_fullsized":"2023-06-09T04:38:11.908192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:05.651229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.922823+0000","last_change":"2023-06-09T04:38:10.504787+0000","last_active":"2023-06-09T04:38:12.922823+0000","last_peered":"2023-06-09T04:38:12.922823+0000","last_clean":"2023-06-09T04:38:12.922823+0000","last_became_active":"2023-06-09T04:38:10.504295+0000","last_became_peered":"2023-06-09T04:38:10.504295+0000","last_unstale":"2023-06-09T04:38:12.922823+0000","last_undegraded":"2023-06-09T04:38:12.922823+0000","last_fullsized":"2023-06-09T04:38:12.922823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:12.341419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.912184+0000","last_change":"2023-06-09T04:38:10.920618+0000","last_active":"2023-06-09T04:38:12.912184+0000","last_peered":"2023-06-09T04:38:12.912184+0000","last_clean":"2023-06-09T04:38:12.912184+0000","last_became_active":"2023-06-09T04:38:10.920242+0000","last_became_peered":"2023-06-09T04:38:10.920242+0000","last_unstale":"2023-06-09T04:38:12.912184+0000","last_undegraded":"2023-06-09T04:38:12.912184+0000","last_fullsized":"2023-06-09T04:38:12.912184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:40:11.326874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.909546+0000","last_change":"2023-06-09T04:38:10.502062+0000","last_active":"2023-06-09T04:38:11.909546+0000","last_peered":"2023-06-09T04:38:11.909546+0000","last_clean":"2023-06-09T04:38:11.909546+0000","last_became_active":"2023-06-09T04:38:10.501789+0000","last_became_peered":"2023-06-09T04:38:10.501789+0000","last_unstale":"2023-06-09T04:38:11.909546+0000","last_undegraded":"2023-06-09T04:38:11.909546+0000","last_fullsized":"2023-06-09T04:38:11.909546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:45.737873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910961+0000","last_change":"2023-06-09T04:38:10.928386+0000","last_active":"2023-06-09T04:38:11.910961+0000","last_peered":"2023-06-09T04:38:11.910961+0000","last_clean":"2023-06-09T04:38:11.910961+0000","last_became_active":"2023-06-09T04:38:10.928058+0000","last_became_peered":"2023-06-09T04:38:10.928058+0000","last_unstale":"2023-06-09T04:38:11.910961+0000","last_undegraded":"2023-06-09T04:38:11.910961+0000","last_fullsized":"2023-06-09T04:38:11.910961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:26:37.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910058+0000","last_change":"2023-06-09T04:38:10.501766+0000","last_active":"2023-06-09T04:38:11.910058+0000","last_peered":"2023-06-09T04:38:11.910058+0000","last_clean":"2023-06-09T04:38:11.910058+0000","last_became_active":"2023-06-09T04:38:10.501430+0000","last_became_peered":"2023-06-09T04:38:10.501430+0000","last_unstale":"2023-06-09T04:38:11.910058+0000","last_undegraded":"2023-06-09T04:38:11.910058+0000","last_fullsized":"2023-06-09T04:38:11.910058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:08.029225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911284+0000","last_change":"2023-06-09T04:38:10.923112+0000","last_active":"2023-06-09T04:38:11.911284+0000","last_peered":"2023-06-09T04:38:11.911284+0000","last_clean":"2023-06-09T04:38:11.911284+0000","last_became_active":"2023-06-09T04:38:10.922870+0000","last_became_peered":"2023-06-09T04:38:10.922870+0000","last_unstale":"2023-06-09T04:38:11.911284+0000","last_undegraded":"2023-06-09T04:38:11.911284+0000","last_fullsized":"2023-06-09T04:38:11.911284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:46:40.646560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196691+0000","last_change":"2023-06-09T04:38:10.498271+0000","last_active":"2023-06-09T04:38:12.196691+0000","last_peered":"2023-06-09T04:38:12.196691+0000","last_clean":"2023-06-09T04:38:12.196691+0000","last_became_active":"2023-06-09T04:38:10.497794+0000","last_became_peered":"2023-06-09T04:38:10.497794+0000","last_unstale":"2023-06-09T04:38:12.196691+0000","last_undegraded":"2023-06-09T04:38:12.196691+0000","last_fullsized":"2023-06-09T04:38:12.196691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:03.860790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196647+0000","last_change":"2023-06-09T04:38:10.920434+0000","last_active":"2023-06-09T04:38:12.196647+0000","last_peered":"2023-06-09T04:38:12.196647+0000","last_clean":"2023-06-09T04:38:12.196647+0000","last_became_active":"2023-06-09T04:38:10.920193+0000","last_became_peered":"2023-06-09T04:38:10.920193+0000","last_unstale":"2023-06-09T04:38:12.196647+0000","last_undegraded":"2023-06-09T04:38:12.196647+0000","last_fullsized":"2023-06-09T04:38:12.196647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:04.721812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.923102+0000","last_change":"2023-06-09T04:38:10.495885+0000","last_active":"2023-06-09T04:38:12.923102+0000","last_peered":"2023-06-09T04:38:12.923102+0000","last_clean":"2023-06-09T04:38:12.923102+0000","last_became_active":"2023-06-09T04:38:10.495591+0000","last_became_peered":"2023-06-09T04:38:10.495591+0000","last_unstale":"2023-06-09T04:38:12.923102+0000","last_undegraded":"2023-06-09T04:38:12.923102+0000","last_fullsized":"2023-06-09T04:38:12.923102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:09.471237+0000","last_clean_scrub_stamp":"2023-06-09T04:38:09.471237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:53:03.716617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.910580+0000","last_change":"2023-06-09T04:38:10.932621+0000","last_active":"2023-06-09T04:38:11.910580+0000","last_peered":"2023-06-09T04:38:11.910580+0000","last_clean":"2023-06-09T04:38:11.910580+0000","last_became_active":"2023-06-09T04:38:10.932338+0000","last_became_peered":"2023-06-09T04:38:10.932338+0000","last_unstale":"2023-06-09T04:38:11.910580+0000","last_undegraded":"2023-06-09T04:38:11.910580+0000","last_fullsized":"2023-06-09T04:38:11.910580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:21.944797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:13.412500+0000","last_change":"2023-06-09T04:38:10.924992+0000","last_active":"2023-06-09T04:38:13.412500+0000","last_peered":"2023-06-09T04:38:13.412500+0000","last_clean":"2023-06-09T04:38:13.412500+0000","last_became_active":"2023-06-09T04:38:10.924719+0000","last_became_peered":"2023-06-09T04:38:10.924719+0000","last_unstale":"2023-06-09T04:38:13.412500+0000","last_undegraded":"2023-06-09T04:38:13.412500+0000","last_fullsized":"2023-06-09T04:38:13.412500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:39.018195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196254+0000","last_change":"2023-06-09T04:38:10.924968+0000","last_active":"2023-06-09T04:38:12.196254+0000","last_peered":"2023-06-09T04:38:12.196254+0000","last_clean":"2023-06-09T04:38:12.196254+0000","last_became_active":"2023-06-09T04:38:10.923343+0000","last_became_peered":"2023-06-09T04:38:10.923343+0000","last_unstale":"2023-06-09T04:38:12.196254+0000","last_undegraded":"2023-06-09T04:38:12.196254+0000","last_fullsized":"2023-06-09T04:38:12.196254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:33:07.911025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.911138+0000","last_change":"2023-06-09T04:38:10.933162+0000","last_active":"2023-06-09T04:38:11.911138+0000","last_peered":"2023-06-09T04:38:11.911138+0000","last_clean":"2023-06-09T04:38:11.911138+0000","last_became_active":"2023-06-09T04:38:10.932932+0000","last_became_peered":"2023-06-09T04:38:10.932932+0000","last_unstale":"2023-06-09T04:38:11.911138+0000","last_undegraded":"2023-06-09T04:38:11.911138+0000","last_fullsized":"2023-06-09T04:38:11.911138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.371647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:12.196656+0000","last_change":"2023-06-09T04:38:10.933639+0000","last_active":"2023-06-09T04:38:12.196656+0000","last_peered":"2023-06-09T04:38:12.196656+0000","last_clean":"2023-06-09T04:38:12.196656+0000","last_became_active":"2023-06-09T04:38:10.933387+0000","last_became_peered":"2023-06-09T04:38:10.933387+0000","last_unstale":"2023-06-09T04:38:12.196656+0000","last_undegraded":"2023-06-09T04:38:12.196656+0000","last_fullsized":"2023-06-09T04:38:12.196656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:04.015524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-09T04:38:11.908167+0000","last_change":"2023-06-09T04:38:10.932336+0000","last_active":"2023-06-09T04:38:11.908167+0000","last_peered":"2023-06-09T04:38:11.908167+0000","last_clean":"2023-06-09T04:38:11.908167+0000","last_became_active":"2023-06-09T04:38:10.932071+0000","last_became_peered":"2023-06-09T04:38:10.932071+0000","last_unstale":"2023-06-09T04:38:11.908167+0000","last_undegraded":"2023-06-09T04:38:11.908167+0000","last_fullsized":"2023-06-09T04:38:11.908167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.476433+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.476433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:46.743068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":835584,"data_stored":670127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":668347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":77400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":76818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":78069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":79599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":78631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:23.085 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T04:38:23.085 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-09T04:38:23.085 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-09T04:38:23.086 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-09T04:38:23.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.240+0000 7f4325cd6700 1 Processor -- start 2023-06-09T04:38:23.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.240+0000 7f4325cd6700 1 -- start start 2023-06-09T04:38:23.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f4325cd6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4320069db0 0x7f43200cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f4325cd6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 0x7f432006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f4325cd6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432006a6c0 con 0x7f432015ff50 2023-06-09T04:38:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f4325cd6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43200ca670 con 0x7f4320069db0 2023-06-09T04:38:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f4325cd6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200aed70 con 0x7f43200ae920 2023-06-09T04:38:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f431ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f432015ff50 0x7f43201603d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46990/0 (socket says 172.21.15.26:46990) 2023-06-09T04:38:23.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f431ffff700 1 -- 172.21.15.26:0/2988553521 learned_addr learned my addr 172.21.15.26:0/2988553521 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f431f7fe700 1 --2- 172.21.15.26:0/2988553521 >> v2:172.21.15.104:3300/0 conn(0x7f4320069db0 0x7f43200cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f431effd700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 0x7f432006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624782707 0 0) 0x7f432006a6c0 con 0x7f432015ff50 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.241+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f430c0035b0 con 0x7f432015ff50 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2395486571 0 0) 0x7f430c0035b0 con 0x7f432015ff50 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 msgr2=0x7f432006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 0x7f432006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 >> v2:172.21.15.104:3300/0 conn(0x7f4320069db0 msgr2=0x7f43200cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 --2- 172.21.15.26:0/2988553521 >> v2:172.21.15.104:3300/0 conn(0x7f4320069db0 0x7f43200cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200ce380 con 0x7f432015ff50 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f43180019f0 con 0x7f432015ff50 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 >> v1:172.21.15.26:6789/0 conn(0x7f432015ff50 legacy=0x7f43201603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c003a00 0x7f430c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f430c004850 0x7f430c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 0x7f430c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c00ba10 con 0x7f430c003a00 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c00bb50 con 0x7f430c004850 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c00bcc0 con 0x7f43200ae920 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c003a00 0x7f430c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431effd700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f430c004850 0x7f430c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431ffff700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 0x7f430c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 -- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 msgr2=0x7f430c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43200ae920 0x7f430c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 -- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f430c004850 msgr2=0x7f430c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f430c004850 0x7f430c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 -- 172.21.15.26:0/2988553521 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0035b0 con 0x7f430c003a00 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431f7fe700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c003a00 0x7f430c003e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4310009b40 tx=0x7f430c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c95f15a1dfe2ed server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310005a20 con 0x7f430c003a00 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310005b80 con 0x7f430c003a00 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.242+0000 7f431e7fc700 1 -- 172.21.15.26:0/2988553521 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e6c0 con 0x7f430c003a00 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f4325cd6700 1 -- 172.21.15.26:0/2988553521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c003a00 msgr2=0x7f430c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f4325cd6700 1 --2- 172.21.15.26:0/2988553521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f430c003a00 0x7f430c003e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4310009b40 tx=0x7f430c005880 comp rx=0 tx=0).stop 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f431ffff700 1 -- 172.21.15.26:0/2988553521 reap_dead start 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f4325cd6700 1 -- 172.21.15.26:0/2988553521 shutdown_connections 2023-06-09T04:38:23.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f4325cd6700 1 -- 172.21.15.26:0/2988553521 >> 172.21.15.26:0/2988553521 conn(0x7f4320098b50 msgr2=0x7f43200cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f4325cd6700 1 -- 172.21.15.26:0/2988553521 shutdown_connections 2023-06-09T04:38:23.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.243+0000 7f4325cd6700 1 -- 172.21.15.26:0/2988553521 wait complete. 2023-06-09T04:38:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.244+0000 7f4325cd6700 1 Processor -- start 2023-06-09T04:38:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.245+0000 7f4325cd6700 1 -- start start 2023-06-09T04:38:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f430c003a00 0x7f43200afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43200c5e00 0x7f432015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 0x7f43200b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432015b1c0 con 0x7f43200c6890 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c5140 con 0x7f43200c5e00 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c5420 con 0x7f430c003a00 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 0x7f43200b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 0x7f43200b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38144/0 (socket says 172.21.15.26:38144) 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 -- 172.21.15.26:0/1963670707 learned_addr learned my addr 172.21.15.26:0/1963670707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431f7fe700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f430c003a00 0x7f43200afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431effd700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43200c5e00 0x7f432015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 -- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f430c003a00 msgr2=0x7f43200afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f430c003a00 0x7f43200afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 -- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43200c5e00 msgr2=0x7f432015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43200c5e00 0x7f432015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 -- 172.21.15.26:0/1963670707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200b3640 con 0x7f43200c6890 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f431ffff700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 0x7f43200b1520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f43200ae720 tx=0x7f4318001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800eba0 con 0x7f43200c6890 2023-06-09T04:38:23.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800ed00 con 0x7f43200c6890 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43200b3920 con 0x7f43200c6890 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.246+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318013660 con 0x7f43200c6890 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.247+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43200b1a60 con 0x7f43200c6890 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.247+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43200b3e40 con 0x7f43200c6890 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.248+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43180137c0 con 0x7f43200c6890 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.248+0000 7f4317fff700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f430006ace0 0x7f430006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.248+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43180899f0 con 0x7f43200c6890 2023-06-09T04:38:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.248+0000 7f431f7fe700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f430006ace0 0x7f430006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.249+0000 7f431f7fe700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f430006ace0 0x7f430006d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4310000c00 tx=0x7f4310008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.252+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43200b3e40 con 0x7f43200c6890 2023-06-09T04:38:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.492+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f43200b3e40 con 0x7f43200c6890 2023-06-09T04:38:23.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.492+0000 7f4317fff700 1 -- 172.21.15.26:0/1963670707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f43200b3e40 con 0x7f43200c6890 2023-06-09T04:38:23.494 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:23.494 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-09T04:38:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f430006ace0 msgr2=0x7f430006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f430006ace0 0x7f430006d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4310000c00 tx=0x7f4310008030 comp rx=0 tx=0).stop 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 msgr2=0x7f43200b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 0x7f43200b1520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f43200ae720 tx=0x7f4318001ae0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 shutdown_connections 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f430006ace0 0x7f430006d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43200c6890 0x7f43200b1520 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f430c003a00 0x7f43200afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 --2- 172.21.15.26:0/1963670707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43200c5e00 0x7f432015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 >> 172.21.15.26:0/1963670707 conn(0x7f4320098b50 msgr2=0x7f432006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 shutdown_connections 2023-06-09T04:38:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.494+0000 7f4325cd6700 1 -- 172.21.15.26:0/1963670707 wait complete. 2023-06-09T04:38:23.507 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-09T04:38:23.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:23.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.630+0000 7fb860a27700 1 Processor -- start 2023-06-09T04:38:23.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.630+0000 7fb860a27700 1 -- start start 2023-06-09T04:38:23.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb860a27700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb860a27700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb85c0cecb0 0x7fb85c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb860a27700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c159880 con 0x7fb85c0ca370 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb860a27700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0cda30 con 0x7fb85c0cecb0 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb860a27700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0ca7e0 con 0x7fb85c0aed90 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb85ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb85c0cecb0 0x7fb85c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb85ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb85c0cecb0 0x7fb85c06da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38152/0 (socket says 172.21.15.26:38152) 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb859d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb85c0ca370 0x7fb85c0ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47006/0 (socket says 172.21.15.26:47006) 2023-06-09T04:38:23.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.631+0000 7fb85ad9d700 1 -- 172.21.15.26:0/230694527 learned_addr learned my addr 172.21.15.26:0/230694527 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85a59c700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85ad9d700 1 -- 172.21.15.26:0/230694527 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 msgr2=0x7fb85c0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85ad9d700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85ad9d700 1 -- 172.21.15.26:0/230694527 >> v1:172.21.15.26:6789/0 conn(0x7fb85c0ca370 legacy=0x7fb85c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85959a700 1 -- 172.21.15.26:0/230694527 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384181623 0 0) 0x7fb85c159880 con 0x7fb85c0ca370 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85ad9d700 1 -- 172.21.15.26:0/230694527 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c06cff0 con 0x7fb85c0cecb0 2023-06-09T04:38:23.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85a59c700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85ad9d700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c06da60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d180 tx=0x7fb85400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b0be36c2709af1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85959a700 1 -- 172.21.15.26:0/230694527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854010070 con 0x7fb85c0cecb0 2023-06-09T04:38:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85959a700 1 -- 172.21.15.26:0/230694527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400ddb0 con 0x7fb85c0cecb0 2023-06-09T04:38:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb85959a700 1 -- 172.21.15.26:0/230694527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400b310 con 0x7fb85c0cecb0 2023-06-09T04:38:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb860a27700 1 -- 172.21.15.26:0/230694527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 msgr2=0x7fb85c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.632+0000 7fb860a27700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c06da60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d180 tx=0x7fb85400d490 comp rx=0 tx=0).stop 2023-06-09T04:38:23.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.633+0000 7fb860a27700 1 -- 172.21.15.26:0/230694527 shutdown_connections 2023-06-09T04:38:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.633+0000 7fb860a27700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c06da60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.633+0000 7fb860a27700 1 --2- 172.21.15.26:0/230694527 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.633+0000 7fb860a27700 1 -- 172.21.15.26:0/230694527 >> 172.21.15.26:0/230694527 conn(0x7fb85c098a30 msgr2=0x7fb85c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.633+0000 7fb860a27700 1 -- 172.21.15.26:0/230694527 shutdown_connections 2023-06-09T04:38:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.633+0000 7fb860a27700 1 -- 172.21.15.26:0/230694527 wait complete. 2023-06-09T04:38:23.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.634+0000 7fb860a27700 1 Processor -- start 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.634+0000 7fb860a27700 1 -- start start 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb860a27700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb860a27700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb85c0ca370 0x7fb85c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb860a27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb860a27700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0afb00 con 0x7fb85c0cecb0 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb860a27700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0af1f0 con 0x7fb85c0ca370 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb860a27700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0b1930 con 0x7fb85c0aed90 2023-06-09T04:38:23.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c0b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38158/0 (socket says 172.21.15.26:38158) 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 -- 172.21.15.26:0/133349860 learned_addr learned my addr 172.21.15.26:0/133349860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb859d9b700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb85c0ca370 0x7fb85c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85a59c700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 -- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 msgr2=0x7fb85c0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 -- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb85c0ca370 msgr2=0x7fb85c154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb85c0ca370 0x7fb85c154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 -- 172.21.15.26:0/133349860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85400bd40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.635+0000 7fb85ad9d700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c0b0eb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d890 tx=0x7fb854004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.636+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400ae40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.636+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400bbc0 con 0x7fb85c0cecb0 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.636+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c0af440 con 0x7fb85c0cecb0 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.636+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854004280 con 0x7fb85c0cecb0 2023-06-09T04:38:23.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.636+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c154850 con 0x7fb85c0cecb0 2023-06-09T04:38:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.637+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c0afc40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.637+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8540043e0 con 0x7fb85c0cecb0 2023-06-09T04:38:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.637+0000 7fb84affd700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb83c06ace0 0x7fb83c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.638+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb85408cb40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.638+0000 7fb85a59c700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb83c06ace0 0x7fb83c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.638+0000 7fb85a59c700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb83c06ace0 0x7fb83c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb85000ab40 tx=0x7fb850008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.642+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb85c0afc40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.841+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85c0afc40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.842+0000 7fb84affd700 1 -- 172.21.15.26:0/133349860 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fb85c0afc40 con 0x7fb85c0cecb0 2023-06-09T04:38:23.844 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:23.844 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.844+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb83c06ace0 msgr2=0x7fb83c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.844+0000 7fb860a27700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb83c06ace0 0x7fb83c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb85000ab40 tx=0x7fb850008040 comp rx=0 tx=0).stop 2023-06-09T04:38:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.844+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 msgr2=0x7fb85c0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.844+0000 7fb860a27700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c0b0eb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d890 tx=0x7fb854004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.844+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 shutdown_connections 2023-06-09T04:38:23.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb83c06ace0 0x7fb83c06d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c0cecb0 0x7fb85c0b0eb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb85c0aed90 0x7fb85c0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 --2- 172.21.15.26:0/133349860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb85c0ca370 0x7fb85c154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 >> 172.21.15.26:0/133349860 conn(0x7fb85c098a30 msgr2=0x7fb85c0c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 shutdown_connections 2023-06-09T04:38:23.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.845+0000 7fb860a27700 1 -- 172.21.15.26:0/133349860 wait complete. 2023-06-09T04:38:23.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:23.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.985+0000 7f33a6a06700 1 Processor -- start 2023-06-09T04:38:23.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.985+0000 7f33a6a06700 1 -- start start 2023-06-09T04:38:23.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f33a6a06700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33a015d820 0x7f33a00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f33a6a06700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a00d0f80 0x7f33a00ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f33a6a06700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a00ad470 con 0x7f33a00b1b30 2023-06-09T04:38:23.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f33a6a06700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a00cf0e0 con 0x7f33a015d820 2023-06-09T04:38:23.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f33a6a06700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00adff0 con 0x7f33a00d0f80 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f339ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33a015d820 0x7f33a00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f339f7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f33a00b1b30 0x7f33a00d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47020/0 (socket says 172.21.15.26:47020) 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f339f7fe700 1 -- 172.21.15.26:0/3611224981 learned_addr learned my addr 172.21.15.26:0/3611224981 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.986+0000 7f33a4fa3700 1 --2- 172.21.15.26:0/3611224981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a00d0f80 0x7f33a00ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339ffff700 1 -- 172.21.15.26:0/3611224981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a00d0f80 msgr2=0x7f33a00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339ffff700 1 --2- 172.21.15.26:0/3611224981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a00d0f80 0x7f33a00ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339ffff700 1 -- 172.21.15.26:0/3611224981 >> v1:172.21.15.26:6789/0 conn(0x7f33a00b1b30 legacy=0x7f33a00d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339effd700 1 -- 172.21.15.26:0/3611224981 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802593282 0 0) 0x7f33a00ad470 con 0x7f33a00b1b30 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339ffff700 1 -- 172.21.15.26:0/3611224981 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00b3730 con 0x7f33a015d820 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339ffff700 1 --2- 172.21.15.26:0/3611224981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a015d820 0x7f33a00ceba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3388009840 tx=0x7f3388009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da3527a646c5007 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339effd700 1 -- 172.21.15.26:0/3611224981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388011830 con 0x7f33a015d820 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339effd700 1 -- 172.21.15.26:0/3611224981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388011990 con 0x7f33a015d820 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f339effd700 1 -- 172.21.15.26:0/3611224981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388011d20 con 0x7f33a015d820 2023-06-09T04:38:23.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f33a6a06700 1 -- 172.21.15.26:0/3611224981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a015d820 msgr2=0x7f33a00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f33a6a06700 1 --2- 172.21.15.26:0/3611224981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a015d820 0x7f33a00ceba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3388009840 tx=0x7f3388009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f33a6a06700 1 -- 172.21.15.26:0/3611224981 shutdown_connections 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f33a6a06700 1 --2- 172.21.15.26:0/3611224981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a00d0f80 0x7f33a00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.987+0000 7f33a6a06700 1 --2- 172.21.15.26:0/3611224981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a015d820 0x7f33a00ceba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.988+0000 7f33a6a06700 1 -- 172.21.15.26:0/3611224981 >> 172.21.15.26:0/3611224981 conn(0x7f33a0089fc0 msgr2=0x7f33a008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.988+0000 7f33a6a06700 1 -- 172.21.15.26:0/3611224981 shutdown_connections 2023-06-09T04:38:23.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.988+0000 7f33a6a06700 1 -- 172.21.15.26:0/3611224981 wait complete. 2023-06-09T04:38:23.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.989+0000 7f33a6a06700 1 Processor -- start 2023-06-09T04:38:23.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.989+0000 7f33a6a06700 1 -- start start 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 0x7f33a009dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33a00d0f80 0x7f33a01ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a015d820 0x7f33a01f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a009e4e0 con 0x7f33a00b1b30 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01f01a0 con 0x7f33a00d0f80 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01f0480 con 0x7f33a015d820 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 0x7f33a009dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 0x7f33a009dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38168/0 (socket says 172.21.15.26:38168) 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 -- 172.21.15.26:0/2571767554 learned_addr learned my addr 172.21.15.26:0/2571767554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339f7fe700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33a00d0f80 0x7f33a01ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a4fa3700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a015d820 0x7f33a01f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 -- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a015d820 msgr2=0x7f33a01f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a015d820 0x7f33a01f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 -- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33a00d0f80 msgr2=0x7f33a01ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33a00d0f80 0x7f33a01ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 -- 172.21.15.26:0/2571767554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880094a0 con 0x7f33a00b1b30 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339ffff700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 0x7f33a009dfa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33880090b0 tx=0x7f3388004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880036a0 con 0x7f33a00b1b30 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338801f070 con 0x7f33a00b1b30 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388003a00 con 0x7f33a00b1b30 2023-06-09T04:38:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.990+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01f0760 con 0x7f33a00b1b30 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.991+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a01f0d20 con 0x7f33a00b1b30 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.991+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a00d0a90 con 0x7f33a00b1b30 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.992+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3388003b60 con 0x7f33a00b1b30 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.992+0000 7f339cff9700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f338006ace0 0x7f338006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.993+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3388021070 con 0x7f33a00b1b30 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.993+0000 7f339f7fe700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f338006ace0 0x7f338006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.993+0000 7f339f7fe700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f338006ace0 0x7f338006d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33a00b1340 tx=0x7f3390007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:23.997+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3388055f60 con 0x7f33a00b1b30 2023-06-09T04:38:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.194+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33a00d07b0 con 0x7f33a00b1b30 2023-06-09T04:38:24.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.195+0000 7f339cff9700 1 -- 172.21.15.26:0/2571767554 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3388059580 con 0x7f33a00b1b30 2023-06-09T04:38:24.196 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f338006ace0 msgr2=0x7f338006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f338006ace0 0x7f338006d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33a00b1340 tx=0x7f3390007e70 comp rx=0 tx=0).stop 2023-06-09T04:38:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 msgr2=0x7f33a009dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 0x7f33a009dfa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33880090b0 tx=0x7f3388004750 comp rx=0 tx=0).stop 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 shutdown_connections 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33a015d820 0x7f33a01f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f338006ace0 0x7f338006d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a00b1b30 0x7f33a009dfa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 --2- 172.21.15.26:0/2571767554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33a00d0f80 0x7f33a01ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 >> 172.21.15.26:0/2571767554 conn(0x7f33a0089fc0 msgr2=0x7f33a00ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 shutdown_connections 2023-06-09T04:38:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.197+0000 7f33a6a06700 1 -- 172.21.15.26:0/2571767554 wait complete. 2023-06-09T04:38:24.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:24.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.336+0000 7fbc54f87700 1 Processor -- start 2023-06-09T04:38:24.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.336+0000 7fbc54f87700 1 -- start start 2023-06-09T04:38:24.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.337+0000 7fbc54f87700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbc5015f9d0 0x7fbc500caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.337+0000 7fbc54f87700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500ce4f0 0x7fbc500ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.337+0000 7fbc54f87700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc500cc160 con 0x7fbc500cc5f0 2023-06-09T04:38:24.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.337+0000 7fbc54f87700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc500cf240 con 0x7fbc5015f9d0 2023-06-09T04:38:24.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.337+0000 7fbc54f87700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500ceea0 con 0x7fbc500ce4f0 2023-06-09T04:38:24.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4ed9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbc500cc5f0 0x7fbc500cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47038/0 (socket says 172.21.15.26:47038) 2023-06-09T04:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4ed9d700 1 -- 172.21.15.26:0/1659480776 learned_addr learned my addr 172.21.15.26:0/1659480776 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4e59c700 1 --2- 172.21.15.26:0/1659480776 >> v2:172.21.15.104:3300/0 conn(0x7fbc5015f9d0 0x7fbc500caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500ce4f0 0x7fbc500ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280570074 0 0) 0x7fbc500cc160 con 0x7fbc500cc5f0 2023-06-09T04:38:24.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc3c0035b0 con 0x7fbc500cc5f0 2023-06-09T04:38:24.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898747478 0 0) 0x7fbc3c0035b0 con 0x7fbc500cc5f0 2023-06-09T04:38:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500ce4f0 msgr2=0x7fbc500ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500ce4f0 0x7fbc500ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 >> v2:172.21.15.104:3300/0 conn(0x7fbc5015f9d0 msgr2=0x7fbc500caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 --2- 172.21.15.26:0/1659480776 >> v2:172.21.15.104:3300/0 conn(0x7fbc5015f9d0 0x7fbc500caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5015fda0 con 0x7fbc500cc5f0 2023-06-09T04:38:24.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fbc480019f0 con 0x7fbc500cc5f0 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 >> v1:172.21.15.26:6789/0 conn(0x7fbc500cc5f0 legacy=0x7fbc500cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc3c003a30 0x7fbc3c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc3c004850 0x7fbc3c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500cf240 con 0x7fbc3c005200 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500ceea0 con 0x7fbc3c003a30 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c00bf80 con 0x7fbc3c004850 2023-06-09T04:38:24.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4e59c700 1 --2- 172.21.15.26:0/1659480776 >> v2:172.21.15.104:3300/0 conn(0x7fbc5015f9d0 0x7fbc500caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500ce4f0 0x7fbc500ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4ed9d700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4e59c700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc3c003a30 0x7fbc3c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.338+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc3c004850 0x7fbc3c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 -- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc3c004850 msgr2=0x7fbc3c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc3c004850 0x7fbc3c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 -- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc3c003a30 msgr2=0x7fbc3c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc3c003a30 0x7fbc3c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 -- 172.21.15.26:0/1659480776 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0035b0 con 0x7fbc3c005200 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc3c00ba10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800a820 tx=0x7fbc3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ddcd6e883f51af server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4800a2f0 con 0x7fbc3c005200 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48012620 con 0x7fbc3c005200 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4d59a700 1 -- 172.21.15.26:0/1659480776 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480129d0 con 0x7fbc3c005200 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc54f87700 1 -- 172.21.15.26:0/1659480776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 msgr2=0x7fbc3c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc54f87700 1 --2- 172.21.15.26:0/1659480776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc3c00ba10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800a820 tx=0x7fbc3c005880 comp rx=0 tx=0).stop 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.339+0000 7fbc4ed9d700 1 -- 172.21.15.26:0/1659480776 reap_dead start 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.340+0000 7fbc54f87700 1 -- 172.21.15.26:0/1659480776 shutdown_connections 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.340+0000 7fbc54f87700 1 -- 172.21.15.26:0/1659480776 >> 172.21.15.26:0/1659480776 conn(0x7fbc50089fc0 msgr2=0x7fbc500d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.340+0000 7fbc54f87700 1 -- 172.21.15.26:0/1659480776 shutdown_connections 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.340+0000 7fbc54f87700 1 -- 172.21.15.26:0/1659480776 wait complete. 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.341+0000 7fbc54f87700 1 Processor -- start 2023-06-09T04:38:24.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.341+0000 7fbc54f87700 1 -- start start 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc50152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500c8a40 0x7fbc50152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc5009a630 0x7fbc5006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc501527d0 con 0x7fbc3c005200 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500ad4b0 con 0x7fbc5009a630 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50153170 con 0x7fbc500c8a40 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc50152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc50152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38188/0 (socket says 172.21.15.26:38188) 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 -- 172.21.15.26:0/3226177612 learned_addr learned my addr 172.21.15.26:0/3226177612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500c8a40 0x7fbc50152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4ed9d700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc5009a630 0x7fbc5006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 -- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500c8a40 msgr2=0x7fbc50152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500c8a40 0x7fbc50152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 -- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc5009a630 msgr2=0x7fbc5006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc5009a630 0x7fbc5006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 -- 172.21.15.26:0/3226177612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500b11f0 con 0x7fbc3c005200 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500c8a40 0x7fbc50152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4ed9d700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc5009a630 0x7fbc5006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc4e59c700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc50152290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc40011d00 tx=0x7fbc4000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000fb30 con 0x7fbc3c005200 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000fcb0 con 0x7fbc3c005200 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc500c8ed0 con 0x7fbc3c005200 2023-06-09T04:38:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40004020 con 0x7fbc3c005200 2023-06-09T04:38:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.342+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc500c9490 con 0x7fbc3c005200 2023-06-09T04:38:24.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.343+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5015e520 con 0x7fbc3c005200 2023-06-09T04:38:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.344+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc40004180 con 0x7fbc3c005200 2023-06-09T04:38:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.344+0000 7fbc46ffd700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbc3006ace0 0x7fbc3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.344+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc40089af0 con 0x7fbc3c005200 2023-06-09T04:38:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.344+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbc3006ace0 0x7fbc3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.345+0000 7fbc4dd9b700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbc3006ace0 0x7fbc3006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc500b14c0 tx=0x7fbc38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.349+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc40054ba0 con 0x7fbc3c005200 2023-06-09T04:38:24.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.549+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc500d1620 con 0x7fbc3c005200 2023-06-09T04:38:24.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.550+0000 7fbc46ffd700 1 -- 172.21.15.26:0/3226177612 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc40022020 con 0x7fbc3c005200 2023-06-09T04:38:24.551 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbc3006ace0 msgr2=0x7fbc3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbc3006ace0 0x7fbc3006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc500b14c0 tx=0x7fbc38008040 comp rx=0 tx=0).stop 2023-06-09T04:38:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 msgr2=0x7fbc50152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc50152290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc40011d00 tx=0x7fbc4000f520 comp rx=0 tx=0).stop 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 shutdown_connections 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc5009a630 0x7fbc5006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbc3006ace0 0x7fbc3006d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc3c005200 0x7fbc50152290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 --2- 172.21.15.26:0/3226177612 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbc500c8a40 0x7fbc50152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 >> 172.21.15.26:0/3226177612 conn(0x7fbc50089fc0 msgr2=0x7fbc500b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 shutdown_connections 2023-06-09T04:38:24.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.552+0000 7fbc54f87700 1 -- 172.21.15.26:0/3226177612 wait complete. 2023-06-09T04:38:24.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.691+0000 7fe6cba54700 1 Processor -- start 2023-06-09T04:38:24.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.691+0000 7fe6cba54700 1 -- start start 2023-06-09T04:38:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6cba54700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe6c40aed90 0x7fe6c40c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6cba54700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6c40ca370 0x7fe6c40ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6cba54700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c4159880 con 0x7fe6c40ceae0 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6cba54700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40ca810 con 0x7fe6c40aed90 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6cba54700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40cda30 con 0x7fe6c40ca370 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c97f0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe6c40aed90 0x7fe6c40c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c9ff1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe6c40ceae0 0x7fe6c40cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47056/0 (socket says 172.21.15.26:47056) 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c9ff1700 1 -- 172.21.15.26:0/1010362884 learned_addr learned my addr 172.21.15.26:0/1010362884 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:24.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c8fef700 1 --2- 172.21.15.26:0/1010362884 >> v2:172.21.15.104:3300/0 conn(0x7fe6c40ca370 0x7fe6c40ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c97f0700 1 -- 172.21.15.26:0/1010362884 >> v2:172.21.15.104:3300/0 conn(0x7fe6c40ca370 msgr2=0x7fe6c40ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c97f0700 1 --2- 172.21.15.26:0/1010362884 >> v2:172.21.15.104:3300/0 conn(0x7fe6c40ca370 0x7fe6c40ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c97f0700 1 -- 172.21.15.26:0/1010362884 >> v1:172.21.15.26:6789/0 conn(0x7fe6c40ceae0 legacy=0x7fe6c40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6bbfff700 1 -- 172.21.15.26:0/1010362884 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939000975 0 0) 0x7fe6c4159880 con 0x7fe6c40ceae0 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c97f0700 1 -- 172.21.15.26:0/1010362884 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c406cff0 con 0x7fe6c40aed90 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6c97f0700 1 --2- 172.21.15.26:0/1010362884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c40c9e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40724d0 tx=0x7fe6c0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a35599820816eb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6bbfff700 1 -- 172.21.15.26:0/1010362884 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0005e30 con 0x7fe6c40aed90 2023-06-09T04:38:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6bbfff700 1 -- 172.21.15.26:0/1010362884 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0006030 con 0x7fe6c40aed90 2023-06-09T04:38:24.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.692+0000 7fe6bbfff700 1 -- 172.21.15.26:0/1010362884 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00063c0 con 0x7fe6c40aed90 2023-06-09T04:38:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 -- 172.21.15.26:0/1010362884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 msgr2=0x7fe6c40c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 --2- 172.21.15.26:0/1010362884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c40c9e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40724d0 tx=0x7fe6c0009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 -- 172.21.15.26:0/1010362884 shutdown_connections 2023-06-09T04:38:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 --2- 172.21.15.26:0/1010362884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c40c9e30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 --2- 172.21.15.26:0/1010362884 >> v2:172.21.15.104:3300/0 conn(0x7fe6c40ca370 0x7fe6c40ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 -- 172.21.15.26:0/1010362884 >> 172.21.15.26:0/1010362884 conn(0x7fe6c4098a30 msgr2=0x7fe6c40cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 -- 172.21.15.26:0/1010362884 shutdown_connections 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.693+0000 7fe6cba54700 1 -- 172.21.15.26:0/1010362884 wait complete. 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.694+0000 7fe6cba54700 1 Processor -- start 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.694+0000 7fe6cba54700 1 -- start start 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6cba54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c4158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6cba54700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6c40ca370 0x7fe6c40ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6cba54700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6c40ceae0 0x7fe6c40ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6cba54700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c415af20 con 0x7fe6c40aed90 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6cba54700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4158d50 con 0x7fe6c40ca370 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6cba54700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c415b340 con 0x7fe6c40ceae0 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c4158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c4158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38200/0 (socket says 172.21.15.26:38200) 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 -- 172.21.15.26:0/2120666607 learned_addr learned my addr 172.21.15.26:0/2120666607 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c8fef700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6c40ca370 0x7fe6c40ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 -- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6c40ceae0 msgr2=0x7fe6c40ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c9ff1700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6c40ceae0 0x7fe6c40ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6c40ceae0 0x7fe6c40ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 -- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6c40ca370 msgr2=0x7fe6c40ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6c40ca370 0x7fe6c40ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c97f0700 1 -- 172.21.15.26:0/2120666607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009430 con 0x7fe6c40aed90 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.695+0000 7fe6c8fef700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6c40ca370 0x7fe6c40ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:24.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.696+0000 7fe6c97f0700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c4158150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c00 tx=0x7fe6c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.696+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0004240 con 0x7fe6c40aed90 2023-06-09T04:38:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.696+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c00043a0 con 0x7fe6c40aed90 2023-06-09T04:38:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.696+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c415a2a0 con 0x7fe6c40aed90 2023-06-09T04:38:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.696+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00036a0 con 0x7fe6c40aed90 2023-06-09T04:38:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.696+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c415a860 con 0x7fe6c40aed90 2023-06-09T04:38:24.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.697+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c4067180 con 0x7fe6c40aed90 2023-06-09T04:38:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.697+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6c0022070 con 0x7fe6c40aed90 2023-06-09T04:38:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.698+0000 7fe6b9ffb700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe6a806ace0 0x7fe6a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.698+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6c008ac70 con 0x7fe6c40aed90 2023-06-09T04:38:24.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.698+0000 7fe6c8fef700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe6a806ace0 0x7fe6a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.698+0000 7fe6c8fef700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe6a806ace0 0x7fe6a806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40adce0 tx=0x7fe6b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.702+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6c0055db0 con 0x7fe6c40aed90 2023-06-09T04:38:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.898+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6c406c500 con 0x7fe6c40aed90 2023-06-09T04:38:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.898+0000 7fe6b9ffb700 1 -- 172.21.15.26:0/2120666607 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6c00593d0 con 0x7fe6c40aed90 2023-06-09T04:38:24.900 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe6a806ace0 msgr2=0x7fe6a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe6a806ace0 0x7fe6a806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40adce0 tx=0x7fe6b4008040 comp rx=0 tx=0).stop 2023-06-09T04:38:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 msgr2=0x7fe6c4158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c4158150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c00 tx=0x7fe6c0004750 comp rx=0 tx=0).stop 2023-06-09T04:38:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 shutdown_connections 2023-06-09T04:38:24.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6c40ceae0 0x7fe6c40ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe6a806ace0 0x7fe6a806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6c40aed90 0x7fe6c4158150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 --2- 172.21.15.26:0/2120666607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6c40ca370 0x7fe6c40ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.900+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 >> 172.21.15.26:0/2120666607 conn(0x7fe6c4098a30 msgr2=0x7fe6c406d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.901+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 shutdown_connections 2023-06-09T04:38:24.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:24.901+0000 7fe6cba54700 1 -- 172.21.15.26:0/2120666607 wait complete. 2023-06-09T04:38:24.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.040+0000 7f74a4fdb700 1 Processor -- start 2023-06-09T04:38:25.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.040+0000 7f74a4fdb700 1 -- start start 2023-06-09T04:38:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f74a4fdb700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f74a00aed50 0x7f74a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f74a4fdb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a006f190 con 0x7f74a015c6e0 2023-06-09T04:38:25.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f74a4fdb700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a006e440 con 0x7f74a006e990 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f74a4fdb700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a006e690 con 0x7f74a00aed50 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f74a015c6e0 0x7f74a00ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47066/0 (socket says 172.21.15.26:47066) 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749e59c700 1 -- 172.21.15.26:0/3315331721 learned_addr learned my addr 172.21.15.26:0/3315331721 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749dd9b700 1 --2- 172.21.15.26:0/3315331721 >> v2:172.21.15.104:3300/0 conn(0x7f74a00aed50 0x7f74a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749d59a700 1 -- 172.21.15.26:0/3315331721 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663048058 0 0) 0x7f74a006f190 con 0x7f74a015c6e0 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749d59a700 1 -- 172.21.15.26:0/3315331721 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74880035b0 con 0x7f74a015c6e0 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749dd9b700 1 -- 172.21.15.26:0/3315331721 >> v1:172.21.15.104:6789/0 conn(0x7f74a006e990 legacy=0x7f74a006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749dd9b700 1 -- 172.21.15.26:0/3315331721 >> v1:172.21.15.26:6789/0 conn(0x7f74a015c6e0 legacy=0x7f74a00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749dd9b700 1 -- 172.21.15.26:0/3315331721 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0160300 con 0x7f74a00aed50 2023-06-09T04:38:25.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.041+0000 7f749dd9b700 1 --2- 172.21.15.26:0/3315331721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a0069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7494009840 tx=0x7f7494009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699760387c006e63 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f749d59a700 1 -- 172.21.15.26:0/3315331721 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494011830 con 0x7f74a00aed50 2023-06-09T04:38:25.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f749d59a700 1 -- 172.21.15.26:0/3315331721 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494011990 con 0x7f74a00aed50 2023-06-09T04:38:25.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f749d59a700 1 -- 172.21.15.26:0/3315331721 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494011d20 con 0x7f74a00aed50 2023-06-09T04:38:25.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 -- 172.21.15.26:0/3315331721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 msgr2=0x7f74a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/3315331721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a0069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7494009840 tx=0x7f7494009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 -- 172.21.15.26:0/3315331721 shutdown_connections 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/3315331721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a0069db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 -- 172.21.15.26:0/3315331721 >> 172.21.15.26:0/3315331721 conn(0x7f74a0098a30 msgr2=0x7f74a00cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 -- 172.21.15.26:0/3315331721 shutdown_connections 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.042+0000 7f74a4fdb700 1 -- 172.21.15.26:0/3315331721 wait complete. 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 Processor -- start 2023-06-09T04:38:25.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 -- start start 2023-06-09T04:38:25.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f74a006e990 0x7f74a00c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 0x7f74a01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a015e5a0 con 0x7f74a015c6e0 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01448c0 con 0x7f74a00aed50 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.044+0000 7f74a4fdb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0144300 con 0x7f74a006e990 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 0x7f74a01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 0x7f74a01567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38218/0 (socket says 172.21.15.26:38218) 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 -- 172.21.15.26:0/2019454447 learned_addr learned my addr 172.21.15.26:0/2019454447 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749dd9b700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749e59c700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f74a006e990 0x7f74a00c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 -- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f74a006e990 msgr2=0x7f74a00c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f74a006e990 0x7f74a00c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 -- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 msgr2=0x7f74a00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a00c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 -- 172.21.15.26:0/2019454447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094a0 con 0x7f74a015c6e0 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749dd9b700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f749ed9d700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 0x7f74a01567e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f749800cbc0 tx=0x7f749800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498003c00 con 0x7f74a015c6e0 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498003d60 con 0x7f74a015c6e0 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a01445e0 con 0x7f74a015c6e0 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800abd0 con 0x7f74a015c6e0 2023-06-09T04:38:25.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.045+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a0141920 con 0x7f74a015c6e0 2023-06-09T04:38:25.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.046+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a015e090 con 0x7f74a015c6e0 2023-06-09T04:38:25.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.047+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f749800ad30 con 0x7f74a015c6e0 2023-06-09T04:38:25.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.047+0000 7f748effd700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f748006ad10 0x7f748006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.047+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7498089510 con 0x7f74a015c6e0 2023-06-09T04:38:25.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.047+0000 7f749e59c700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f748006ad10 0x7f748006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.048+0000 7f749e59c700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f748006ad10 0x7f748006d1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7490007fd0 tx=0x7f7490009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.051+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74a015e090 con 0x7f74a015c6e0 2023-06-09T04:38:25.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.247+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74a015e090 con 0x7f74a015c6e0 2023-06-09T04:38:25.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.247+0000 7f748effd700 1 -- 172.21.15.26:0/2019454447 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74a015e090 con 0x7f74a015c6e0 2023-06-09T04:38:25.250 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f748006ad10 msgr2=0x7f748006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f748006ad10 0x7f748006d1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7490007fd0 tx=0x7f7490009040 comp rx=0 tx=0).stop 2023-06-09T04:38:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 msgr2=0x7f74a01567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 0x7f74a01567e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f749800cbc0 tx=0x7f749800cf80 comp rx=0 tx=0).stop 2023-06-09T04:38:25.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 shutdown_connections 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f748006ad10 0x7f748006d1c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74a015c6e0 0x7f74a01567e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f74a006e990 0x7f74a00c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 --2- 172.21.15.26:0/2019454447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74a00aed50 0x7f74a00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 >> 172.21.15.26:0/2019454447 conn(0x7f74a0098a30 msgr2=0x7f74a00cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 shutdown_connections 2023-06-09T04:38:25.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.249+0000 7f74a4fdb700 1 -- 172.21.15.26:0/2019454447 wait complete. 2023-06-09T04:38:25.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.385+0000 7ff53b6de700 1 Processor -- start 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.385+0000 7ff53b6de700 1 -- start start 2023-06-09T04:38:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff53b6de700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff53415c6e0 0x7ff5340ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff53b6de700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 0x7ff5340aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff53b6de700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53406f190 con 0x7ff534098e30 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff53b6de700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53406e440 con 0x7ff53415c6e0 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff53b6de700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53406e690 con 0x7ff53406e990 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff539c7b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff534098e30 0x7ff5340cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47082/0 (socket says 172.21.15.26:47082) 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff539c7b700 1 -- 172.21.15.26:0/2189358544 learned_addr learned my addr 172.21.15.26:0/2189358544 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff538c79700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 0x7ff5340aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff53947a700 1 --2- 172.21.15.26:0/2189358544 >> v2:172.21.15.104:3300/0 conn(0x7ff53415c6e0 0x7ff5340ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793368434 0 0) 0x7ff53406f190 con 0x7ff534098e30 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.386+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5200035b0 con 0x7ff534098e30 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 409487166 0 0) 0x7ff5200035b0 con 0x7ff534098e30 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 msgr2=0x7ff5340aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 0x7ff5340aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 >> v2:172.21.15.104:3300/0 conn(0x7ff53415c6e0 msgr2=0x7ff5340ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 --2- 172.21.15.26:0/2189358544 >> v2:172.21.15.104:3300/0 conn(0x7ff53415c6e0 0x7ff5340ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534160300 con 0x7ff534098e30 2023-06-09T04:38:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7ff52c0019f0 con 0x7ff534098e30 2023-06-09T04:38:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 >> v1:172.21.15.26:6789/0 conn(0x7ff534098e30 legacy=0x7ff5340cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 0x7ff520003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff520003f80 0x7ff520004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff520004d90 0x7ff520005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53406e440 con 0x7ff520004d90 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53406e690 con 0x7ff520003f80 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52000ba40 con 0x7ff53406e990 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff520004d90 0x7ff520005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff53947a700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 0x7ff520003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff538c79700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff520003f80 0x7ff520004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 -- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 msgr2=0x7ff520003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff53406e990 0x7ff520003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 -- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff520003f80 msgr2=0x7ff520004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff520003f80 0x7ff520004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 -- 172.21.15.26:0/2189358544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200035b0 con 0x7ff520004d90 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff539c7b700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff520004d90 0x7ff520005200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00a860 tx=0x7ff520005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea67197683fba29 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c012600 con 0x7ff520004d90 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c012780 con 0x7ff520004d90 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.387+0000 7ff52bfff700 1 -- 172.21.15.26:0/2189358544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c012b30 con 0x7ff520004d90 2023-06-09T04:38:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff53b6de700 1 -- 172.21.15.26:0/2189358544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff520004d90 msgr2=0x7ff520005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff53b6de700 1 --2- 172.21.15.26:0/2189358544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff520004d90 0x7ff520005200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00a860 tx=0x7ff520005880 comp rx=0 tx=0).stop 2023-06-09T04:38:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff539c7b700 1 -- 172.21.15.26:0/2189358544 reap_dead start 2023-06-09T04:38:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff53b6de700 1 -- 172.21.15.26:0/2189358544 shutdown_connections 2023-06-09T04:38:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff53b6de700 1 -- 172.21.15.26:0/2189358544 >> 172.21.15.26:0/2189358544 conn(0x7ff534098a30 msgr2=0x7ff5340cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff53b6de700 1 -- 172.21.15.26:0/2189358544 shutdown_connections 2023-06-09T04:38:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.388+0000 7ff53b6de700 1 -- 172.21.15.26:0/2189358544 wait complete. 2023-06-09T04:38:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.389+0000 7ff53b6de700 1 Processor -- start 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.389+0000 7ff53b6de700 1 -- start start 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53b6de700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff520004d90 0x7ff53415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53b6de700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff53415e480 0x7ff53415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53b6de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 0x7ff53415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53b6de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c3310 con 0x7ff53415cb20 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53b6de700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53415ee30 con 0x7ff53415e480 2023-06-09T04:38:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53b6de700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340996c0 con 0x7ff520004d90 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 0x7ff53415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff53947a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff520004d90 0x7ff53415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 0x7ff53415cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38236/0 (socket says 172.21.15.26:38236) 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff538c79700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff53415e480 0x7ff53415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 -- 172.21.15.26:0/4284242145 learned_addr learned my addr 172.21.15.26:0/4284242145 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 -- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff520004d90 msgr2=0x7ff53415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff520004d90 0x7ff53415ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 -- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff53415e480 msgr2=0x7ff53415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff53415e480 0x7ff53415e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.390+0000 7ff539c7b700 1 -- 172.21.15.26:0/4284242145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53415d850 con 0x7ff53415cb20 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.391+0000 7ff539c7b700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 0x7ff53415cfc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff520004770 tx=0x7ff52c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.391+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c01e600 con 0x7ff53415cb20 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.391+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c01e780 con 0x7ff53415cb20 2023-06-09T04:38:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.391+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53415db30 con 0x7ff53415cb20 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.391+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c01eb30 con 0x7ff53415cb20 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.391+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5340c3800 con 0x7ff53415cb20 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.392+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5340c3a20 con 0x7ff53415cb20 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.392+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff52c019030 con 0x7ff53415cb20 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.393+0000 7ff529ffb700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff51806ace0 0x7ff51806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.393+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff52c08a800 con 0x7ff53415cb20 2023-06-09T04:38:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.393+0000 7ff53947a700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff51806ace0 0x7ff51806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.393+0000 7ff53947a700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff51806ace0 0x7ff51806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff524009cc0 tx=0x7ff5240091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.397+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff52c055b20 con 0x7ff53415cb20 2023-06-09T04:38:25.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.640+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff53415dcc0 con 0x7ff53415cb20 2023-06-09T04:38:25.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.641+0000 7ff529ffb700 1 -- 172.21.15.26:0/4284242145 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7ff52c017090 con 0x7ff53415cb20 2023-06-09T04:38:25.642 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:25.642 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:25.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff51806ace0 msgr2=0x7ff51806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff51806ace0 0x7ff51806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff524009cc0 tx=0x7ff5240091c0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 msgr2=0x7ff53415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 0x7ff53415cfc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff520004770 tx=0x7ff52c001d80 comp rx=0 tx=0).stop 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 shutdown_connections 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff51806ace0 0x7ff51806d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff53415cb20 0x7ff53415cfc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff520004d90 0x7ff53415ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 --2- 172.21.15.26:0/4284242145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff53415e480 0x7ff53415e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 >> 172.21.15.26:0/4284242145 conn(0x7ff534098a30 msgr2=0x7ff534069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 shutdown_connections 2023-06-09T04:38:25.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.643+0000 7ff53b6de700 1 -- 172.21.15.26:0/4284242145 wait complete. 2023-06-09T04:38:25.646 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:38:25.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:25.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 Processor -- start 2023-06-09T04:38:25.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 -- start start 2023-06-09T04:38:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd1815a2b0 0x7fdd1806e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd180ccd50 0x7fdd180ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180ac3b0 con 0x7fdd180cc1d0 2023-06-09T04:38:25.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1815a680 con 0x7fdd180ccd50 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.780+0000 7fdd1ded7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180ca500 con 0x7fdd1815a2b0 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd180ccd50 0x7fdd180ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd180ccd50 0x7fdd180ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38244/0 (socket says 172.21.15.26:38244) 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 -- 172.21.15.26:0/3104270184 learned_addr learned my addr 172.21.15.26:0/3104270184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd177fe700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd1815a2b0 0x7fdd1806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 -- 172.21.15.26:0/3104270184 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd1815a2b0 msgr2=0x7fdd1806e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd1815a2b0 0x7fdd1806e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 -- 172.21.15.26:0/3104270184 >> v1:172.21.15.104:6789/0 conn(0x7fdd180cc1d0 legacy=0x7fdd180cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 -- 172.21.15.26:0/3104270184 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1806ed60 con 0x7fdd180ccd50 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd177fe700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd1815a2b0 0x7fdd1806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd17fff700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180ca990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009e80 tx=0x7fdd1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49d1d15fb4f6067 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd167fc700 1 -- 172.21.15.26:0/3104270184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000e070 con 0x7fdd180ccd50 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd167fc700 1 -- 172.21.15.26:0/3104270184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000b980 con 0x7fdd180ccd50 2023-06-09T04:38:25.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.781+0000 7fdd167fc700 1 -- 172.21.15.26:0/3104270184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000bd30 con 0x7fdd180ccd50 2023-06-09T04:38:25.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 -- 172.21.15.26:0/3104270184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 msgr2=0x7fdd180ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180ca990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009e80 tx=0x7fdd1000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 -- 172.21.15.26:0/3104270184 shutdown_connections 2023-06-09T04:38:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180ca990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/3104270184 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd1815a2b0 0x7fdd1806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 -- 172.21.15.26:0/3104270184 >> 172.21.15.26:0/3104270184 conn(0x7fdd18098b50 msgr2=0x7fdd180cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 -- 172.21.15.26:0/3104270184 shutdown_connections 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.782+0000 7fdd1ded7700 1 -- 172.21.15.26:0/3104270184 wait complete. 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.783+0000 7fdd1ded7700 1 Processor -- start 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 -- start start 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd180cc1d0 0x7fdd180b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd1815a2b0 0x7fdd18152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181e2d80 con 0x7fdd180ccd50 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181e3060 con 0x7fdd1815a2b0 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.784+0000 7fdd1ded7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181e3340 con 0x7fdd180cc1d0 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38248/0 (socket says 172.21.15.26:38248) 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 -- 172.21.15.26:0/2636412531 learned_addr learned my addr 172.21.15.26:0/2636412531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd17fff700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd1815a2b0 0x7fdd18152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd177fe700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd180cc1d0 0x7fdd180b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 -- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd180cc1d0 msgr2=0x7fdd180b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd180cc1d0 0x7fdd180b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 -- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd1815a2b0 msgr2=0x7fdd18152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd1815a2b0 0x7fdd18152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 -- 172.21.15.26:0/2636412531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd10009b30 con 0x7fdd180ccd50 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd17fff700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd1815a2b0 0x7fdd18152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd177fe700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd180cc1d0 0x7fdd180b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd16ffd700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180af890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c4e0 tx=0x7fdd0c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0052d0 con 0x7fdd180ccd50 2023-06-09T04:38:25.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c005430 con 0x7fdd180ccd50 2023-06-09T04:38:25.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd181e3620 con 0x7fdd180ccd50 2023-06-09T04:38:25.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0038c0 con 0x7fdd180ccd50 2023-06-09T04:38:25.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.785+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd180b1ca0 con 0x7fdd180ccd50 2023-06-09T04:38:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.786+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd181e3b40 con 0x7fdd180ccd50 2023-06-09T04:38:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.787+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd0c003a20 con 0x7fdd180ccd50 2023-06-09T04:38:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.787+0000 7fdcfffff700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdd0406ace0 0x7fdd0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.787+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd0c088ab0 con 0x7fdd180ccd50 2023-06-09T04:38:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.787+0000 7fdd177fe700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdd0406ace0 0x7fdd0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.788+0000 7fdd177fe700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdd0406ace0 0x7fdd0406d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800a970 tx=0x7fdd08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.791+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd181e3b40 con 0x7fdd180ccd50 2023-06-09T04:38:25.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.990+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd181e3b40 con 0x7fdd180ccd50 2023-06-09T04:38:25.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.992+0000 7fdcfffff700 1 -- 172.21.15.26:0/2636412531 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7fdd0c074740 con 0x7fdd180ccd50 2023-06-09T04:38:25.993 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:25.993 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdd0406ace0 msgr2=0x7fdd0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdd0406ace0 0x7fdd0406d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800a970 tx=0x7fdd08008040 comp rx=0 tx=0).stop 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 msgr2=0x7fdd180af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180af890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c4e0 tx=0x7fdd0c00c8a0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 shutdown_connections 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd1815a2b0 0x7fdd18152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdd180cc1d0 0x7fdd180b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fdd0406ace0 0x7fdd0406d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.993+0000 7fdd1ded7700 1 --2- 172.21.15.26:0/2636412531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd180ccd50 0x7fdd180af890 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.994+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 >> 172.21.15.26:0/2636412531 conn(0x7fdd18098b50 msgr2=0x7fdd18158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.994+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 shutdown_connections 2023-06-09T04:38:25.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:25.994+0000 7fdd1ded7700 1 -- 172.21.15.26:0/2636412531 wait complete. 2023-06-09T04:38:26.007 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:26.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:26.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.133+0000 7fe3f418c700 1 Processor -- start 2023-06-09T04:38:26.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.134+0000 7fe3f418c700 1 -- start start 2023-06-09T04:38:26.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.134+0000 7fe3f418c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.134+0000 7fe3f418c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec06f190 con 0x7fe3ec06e990 2023-06-09T04:38:26.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.134+0000 7fe3f418c700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec06e440 con 0x7fe3ec098e30 2023-06-09T04:38:26.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.134+0000 7fe3f418c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0ce500 con 0x7fe3ec15c6e0 2023-06-09T04:38:26.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1727700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe3ec06e990 0x7fe3ec0cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47114/0 (socket says 172.21.15.26:47114) 2023-06-09T04:38:26.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1727700 1 -- 172.21.15.26:0/3906195065 learned_addr learned my addr 172.21.15.26:0/3906195065 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:26.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1f28700 1 --2- 172.21.15.26:0/3906195065 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1f28700 1 -- 172.21.15.26:0/3906195065 >> v1:172.21.15.104:6789/0 conn(0x7fe3ec098e30 legacy=0x7fe3ec0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1f28700 1 -- 172.21.15.26:0/3906195065 >> v1:172.21.15.26:6789/0 conn(0x7fe3ec06e990 legacy=0x7fe3ec0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1f28700 1 -- 172.21.15.26:0/3906195065 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec06e690 con 0x7fe3ec15c6e0 2023-06-09T04:38:26.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.135+0000 7fe3f1f28700 1 --2- 172.21.15.26:0/3906195065 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec0ae640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009850 tx=0x7fe3e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b67655714bfd207 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f0f26700 1 -- 172.21.15.26:0/3906195065 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8005e30 con 0x7fe3ec15c6e0 2023-06-09T04:38:26.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f0f26700 1 -- 172.21.15.26:0/3906195065 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8006030 con 0x7fe3ec15c6e0 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f0f26700 1 -- 172.21.15.26:0/3906195065 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80063c0 con 0x7fe3ec15c6e0 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f418c700 1 -- 172.21.15.26:0/3906195065 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 msgr2=0x7fe3ec0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f418c700 1 --2- 172.21.15.26:0/3906195065 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec0ae640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009850 tx=0x7fe3e8009b60 comp rx=0 tx=0).stop 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f418c700 1 -- 172.21.15.26:0/3906195065 shutdown_connections 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f418c700 1 --2- 172.21.15.26:0/3906195065 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec0ae640 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f418c700 1 -- 172.21.15.26:0/3906195065 >> 172.21.15.26:0/3906195065 conn(0x7fe3ec098a30 msgr2=0x7fe3ec0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:26.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.137+0000 7fe3f418c700 1 -- 172.21.15.26:0/3906195065 shutdown_connections 2023-06-09T04:38:26.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.138+0000 7fe3f418c700 1 -- 172.21.15.26:0/3906195065 wait complete. 2023-06-09T04:38:26.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.139+0000 7fe3f418c700 1 Processor -- start 2023-06-09T04:38:26.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.139+0000 7fe3f418c700 1 -- start start 2023-06-09T04:38:26.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.139+0000 7fe3f418c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 0x7fe3ec15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.139+0000 7fe3f418c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3ec098e30 0x7fe3ec15f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.139+0000 7fe3f418c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f418c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec15ce20 con 0x7fe3ec06e990 2023-06-09T04:38:26.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f418c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec15d100 con 0x7fe3ec098e30 2023-06-09T04:38:26.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f418c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec15d3e0 con 0x7fe3ec15c6e0 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 0x7fe3ec15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 0x7fe3ec15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38260/0 (socket says 172.21.15.26:38260) 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 -- 172.21.15.26:0/669787118 learned_addr learned my addr 172.21.15.26:0/669787118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1727700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3ec098e30 0x7fe3ec15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f2729700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 -- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 msgr2=0x7fe3ec1f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec1f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 -- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3ec098e30 msgr2=0x7fe3ec15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3ec098e30 0x7fe3ec15f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 -- 172.21.15.26:0/669787118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009430 con 0x7fe3ec06e990 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f1f28700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 0x7fe3ec15dec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8000c00 tx=0x7fe3e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8004240 con 0x7fe3ec06e990 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e80043a0 con 0x7fe3ec06e990 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec15d6c0 con 0x7fe3ec06e990 2023-06-09T04:38:26.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80036a0 con 0x7fe3ec06e990 2023-06-09T04:38:26.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.140+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec15cab0 con 0x7fe3ec06e990 2023-06-09T04:38:26.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.141+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec067180 con 0x7fe3ec06e990 2023-06-09T04:38:26.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.142+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3e8022070 con 0x7fe3ec06e990 2023-06-09T04:38:26.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.142+0000 7fe3e27fc700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d006ace0 0x7fe3d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.142+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3e808ad80 con 0x7fe3ec06e990 2023-06-09T04:38:26.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.142+0000 7fe3f1727700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d006ace0 0x7fe3d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.143+0000 7fe3f1727700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d006ace0 0x7fe3d006d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc005910 tx=0x7fe3dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.146+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3e8055ec0 con 0x7fe3ec06e990 2023-06-09T04:38:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.345+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3ec0ce6f0 con 0x7fe3ec06e990 2023-06-09T04:38:26.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.345+0000 7fe3e27fc700 1 -- 172.21.15.26:0/669787118 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3e802a020 con 0x7fe3ec06e990 2023-06-09T04:38:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.347+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d006ace0 msgr2=0x7fe3d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.347+0000 7fe3f418c700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d006ace0 0x7fe3d006d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc005910 tx=0x7fe3dc009040 comp rx=0 tx=0).stop 2023-06-09T04:38:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 msgr2=0x7fe3ec15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 0x7fe3ec15dec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8000c00 tx=0x7fe3e8004750 comp rx=0 tx=0).stop 2023-06-09T04:38:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 shutdown_connections 2023-06-09T04:38:26.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3ec15c6e0 0x7fe3ec1f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe3d006ace0 0x7fe3d006d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3ec06e990 0x7fe3ec15dec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 --2- 172.21.15.26:0/669787118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3ec098e30 0x7fe3ec15f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 >> 172.21.15.26:0/669787118 conn(0x7fe3ec098a30 msgr2=0x7fe3ec0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 shutdown_connections 2023-06-09T04:38:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.348+0000 7fe3f418c700 1 -- 172.21.15.26:0/669787118 wait complete. 2023-06-09T04:38:26.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.487+0000 7fcc08565700 1 Processor -- start 2023-06-09T04:38:26.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.487+0000 7fcc08565700 1 -- start start 2023-06-09T04:38:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc08565700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcc0006b1a0 0x7fcc0015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc08565700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0006e100 con 0x7fcc0015a380 2023-06-09T04:38:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc08565700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0006e3e0 con 0x7fcc000710d0 2023-06-09T04:38:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc08565700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0015dd10 con 0x7fcc0006b1a0 2023-06-09T04:38:26.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc06301700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcc0015a380 0x7fcc000709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47126/0 (socket says 172.21.15.26:47126) 2023-06-09T04:38:26.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc06301700 1 -- 172.21.15.26:0/3152738926 learned_addr learned my addr 172.21.15.26:0/3152738926 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc06b02700 1 --2- 172.21.15.26:0/3152738926 >> v2:172.21.15.104:3300/0 conn(0x7fcc0006b1a0 0x7fcc0015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515924486 0 0) 0x7fcc0006e100 con 0x7fcc0015a380 2023-06-09T04:38:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbec0035b0 con 0x7fcc0015a380 2023-06-09T04:38:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 318672190 0 0) 0x7fcbec0035b0 con 0x7fcc0015a380 2023-06-09T04:38:26.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 >> v2:172.21.15.104:3300/0 conn(0x7fcc0006b1a0 msgr2=0x7fcc0015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 --2- 172.21.15.26:0/3152738926 >> v2:172.21.15.104:3300/0 conn(0x7fcc0006b1a0 0x7fcc0015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 >> v1:172.21.15.104:6789/0 conn(0x7fcc000710d0 legacy=0x7fcc00069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.488+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0015dff0 con 0x7fcc0015a380 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fcbfc001670 con 0x7fcc0015a380 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 >> v1:172.21.15.26:6789/0 conn(0x7fcc0015a380 legacy=0x7fcc000709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbec003a00 0x7fcbec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbec004850 0x7fcbec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcbec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0015dd10 con 0x7fcbec005200 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec00c110 con 0x7fcbec004850 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec00c2d0 con 0x7fcbec003a00 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcbec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc05b00700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbec004850 0x7fcbec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06301700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbec003a00 0x7fcbec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 -- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbec003a00 msgr2=0x7fcbec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbec003a00 0x7fcbec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 -- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbec004850 msgr2=0x7fcbec004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbec004850 0x7fcbec004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 -- 172.21.15.26:0/3152738926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0035b0 con 0x7fcbec005200 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 -- 172.21.15.26:0/3152738926 reap_dead start 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc06b02700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcbec00ba10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009fc0 tx=0x7fcbec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c567e79b3ed8b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8003a20 con 0x7fcbec005200 2023-06-09T04:38:26.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800f040 con 0x7fcbec005200 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.489+0000 7fcc052ff700 1 -- 172.21.15.26:0/3152738926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8003de0 con 0x7fcbec005200 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 -- 172.21.15.26:0/3152738926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 msgr2=0x7fcbec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcbec00ba10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009fc0 tx=0x7fcbec005880 comp rx=0 tx=0).stop 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 -- 172.21.15.26:0/3152738926 shutdown_connections 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 --2- 172.21.15.26:0/3152738926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcbec00ba10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 -- 172.21.15.26:0/3152738926 >> 172.21.15.26:0/3152738926 conn(0x7fcc000cb9d0 msgr2=0x7fcc000cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 -- 172.21.15.26:0/3152738926 shutdown_connections 2023-06-09T04:38:26.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.490+0000 7fcc08565700 1 -- 172.21.15.26:0/3152738926 wait complete. 2023-06-09T04:38:26.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.491+0000 7fcc08565700 1 Processor -- start 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.491+0000 7fcc08565700 1 -- start start 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc08565700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcc000b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc08565700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc000b47b0 0x7fcc000b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc08565700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc00154dd0 0x7fcc000b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc08565700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c9200 con 0x7fcbec005200 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc08565700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c6970 con 0x7fcc00154dd0 2023-06-09T04:38:26.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc08565700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c6bf0 con 0x7fcc000b47b0 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcc000b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcc000b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38280/0 (socket says 172.21.15.26:38280) 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 -- 172.21.15.26:0/1622983240 learned_addr learned my addr 172.21.15.26:0/1622983240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc05b00700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc000b47b0 0x7fcc000b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06b02700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc00154dd0 0x7fcc000b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 -- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc000b47b0 msgr2=0x7fcc000b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc000b47b0 0x7fcc000b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 -- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc00154dd0 msgr2=0x7fcc000b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc00154dd0 0x7fcc000b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 -- 172.21.15.26:0/1622983240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000b30c0 con 0x7fcbec005200 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.492+0000 7fcc06301700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcc000b2790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007310 tx=0x7fcbfc007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.493+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc011580 con 0x7fcbec005200 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.493+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc011720 con 0x7fcbec005200 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.493+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc000b33a0 con 0x7fcbec005200 2023-06-09T04:38:26.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.493+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc011ad0 con 0x7fcbec005200 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.493+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc000b2cd0 con 0x7fcbec005200 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.494+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0009cf60 con 0x7fcbec005200 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.494+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbfc011c30 con 0x7fcbec005200 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.495+0000 7fcbf6ffd700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcbe406ace0 0x7fcbe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.495+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbfc0894e0 con 0x7fcbec005200 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.495+0000 7fcc05b00700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcbe406ace0 0x7fcbe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.495+0000 7fcc05b00700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcbe406ace0 0x7fcbe406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc00159450 tx=0x7fcbf0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.499+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbfc054590 con 0x7fcbec005200 2023-06-09T04:38:26.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.694+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc000b2e60 con 0x7fcbec005200 2023-06-09T04:38:26.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.694+0000 7fcbf6ffd700 1 -- 172.21.15.26:0/1622983240 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbfc057bb0 con 0x7fcbec005200 2023-06-09T04:38:26.696 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:26.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcbe406ace0 msgr2=0x7fcbe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcbe406ace0 0x7fcbe406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc00159450 tx=0x7fcbf0009040 comp rx=0 tx=0).stop 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 msgr2=0x7fcc000b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcc000b2790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007310 tx=0x7fcbfc007620 comp rx=0 tx=0).stop 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 shutdown_connections 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc00154dd0 0x7fcc000b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcbe406ace0 0x7fcbe406d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbec005200 0x7fcc000b2790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 --2- 172.21.15.26:0/1622983240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc000b47b0 0x7fcc000b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 >> 172.21.15.26:0/1622983240 conn(0x7fcc000cb9d0 msgr2=0x7fcc00155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:26.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 shutdown_connections 2023-06-09T04:38:26.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.696+0000 7fcc08565700 1 -- 172.21.15.26:0/1622983240 wait complete. 2023-06-09T04:38:26.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.834+0000 7feecbaa4700 1 Processor -- start 2023-06-09T04:38:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.835+0000 7feecbaa4700 1 -- start start 2023-06-09T04:38:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.835+0000 7feecbaa4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feec40b0240 0x7feec40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.835+0000 7feecbaa4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40b0740 con 0x7feec40ce6c0 2023-06-09T04:38:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.835+0000 7feecbaa4700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40b0a20 con 0x7feec40d1270 2023-06-09T04:38:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.835+0000 7feecbaa4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec415c9a0 con 0x7feec40b0240 2023-06-09T04:38:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feeca041700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feec40b0240 0x7feec40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feec9840700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feec40ce6c0 0x7feec40cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47146/0 (socket says 172.21.15.26:47146) 2023-06-09T04:38:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feec9840700 1 -- 172.21.15.26:0/3529425435 learned_addr learned my addr 172.21.15.26:0/3529425435 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:26.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feeca041700 1 -- 172.21.15.26:0/3529425435 >> v1:172.21.15.104:6789/0 conn(0x7feec40d1270 legacy=0x7feec40caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feeca041700 1 -- 172.21.15.26:0/3529425435 >> v1:172.21.15.26:6789/0 conn(0x7feec40ce6c0 legacy=0x7feec40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feeca041700 1 -- 172.21.15.26:0/3529425435 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40b0d00 con 0x7feec40b0240 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feeca041700 1 --2- 172.21.15.26:0/3529425435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec40cb640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feebc009d90 tx=0x7feebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3112f9aa653f206c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feec883e700 1 -- 172.21.15.26:0/3529425435 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00e070 con 0x7feec40b0240 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feec883e700 1 -- 172.21.15.26:0/3529425435 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00bbd0 con 0x7feec40b0240 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.836+0000 7feec883e700 1 -- 172.21.15.26:0/3529425435 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc012430 con 0x7feec40b0240 2023-06-09T04:38:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 -- 172.21.15.26:0/3529425435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 msgr2=0x7feec40cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 --2- 172.21.15.26:0/3529425435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec40cb640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feebc009d90 tx=0x7feebc00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 -- 172.21.15.26:0/3529425435 shutdown_connections 2023-06-09T04:38:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 --2- 172.21.15.26:0/3529425435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec40cb640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 -- 172.21.15.26:0/3529425435 >> 172.21.15.26:0/3529425435 conn(0x7feec4089fc0 msgr2=0x7feec408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 -- 172.21.15.26:0/3529425435 shutdown_connections 2023-06-09T04:38:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.837+0000 7feecbaa4700 1 -- 172.21.15.26:0/3529425435 wait complete. 2023-06-09T04:38:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.838+0000 7feecbaa4700 1 Processor -- start 2023-06-09T04:38:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.838+0000 7feecbaa4700 1 -- start start 2023-06-09T04:38:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feecbaa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feecbaa4700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feec40ce6c0 0x7feec40b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feecbaa4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feec40d1270 0x7feec415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feecbaa4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41f2f70 con 0x7feec40b0240 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feecbaa4700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41f2380 con 0x7feec40d1270 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feecbaa4700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b5610 con 0x7feec40ce6c0 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec41579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38294/0 (socket says 172.21.15.26:38294) 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 -- 172.21.15.26:0/4100096979 learned_addr learned my addr 172.21.15.26:0/4100096979 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:26.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feeca041700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feec40d1270 0x7feec415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec903f700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feec40ce6c0 0x7feec40b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 -- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feec40ce6c0 msgr2=0x7feec40b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feec40ce6c0 0x7feec40b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 -- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feec40d1270 msgr2=0x7feec415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feec40d1270 0x7feec415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 -- 172.21.15.26:0/4100096979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc009a70 con 0x7feec40b0240 2023-06-09T04:38:26.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.839+0000 7feec9840700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec41579a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feec000c520 tx=0x7feec000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.840+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0005d70 con 0x7feec40b0240 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.840+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00070d0 con 0x7feec40b0240 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.840+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec41f2640 con 0x7feec40b0240 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.840+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0007440 con 0x7feec40b0240 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.840+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec41f2c00 con 0x7feec40b0240 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.840+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec40b3710 con 0x7feec40b0240 2023-06-09T04:38:26.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.841+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feec00075a0 con 0x7feec40b0240 2023-06-09T04:38:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.841+0000 7feeb67fc700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feea806ace0 0x7feea806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.842+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feec00886a0 con 0x7feec40b0240 2023-06-09T04:38:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.842+0000 7feec903f700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feea806ace0 0x7feea806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:26.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.842+0000 7feec903f700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feea806ace0 0x7feea806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feec40ccf60 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:26.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:26.846+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feec0053890 con 0x7feec40b0240 2023-06-09T04:38:27.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.044+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feec40b6740 con 0x7feec40b0240 2023-06-09T04:38:27.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.044+0000 7feeb67fc700 1 -- 172.21.15.26:0/4100096979 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7feec0056eb0 con 0x7feec40b0240 2023-06-09T04:38:27.046 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feea806ace0 msgr2=0x7feea806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feea806ace0 0x7feea806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feec40ccf60 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2023-06-09T04:38:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 msgr2=0x7feec41579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec41579a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feec000c520 tx=0x7feec000c830 comp rx=0 tx=0).stop 2023-06-09T04:38:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 shutdown_connections 2023-06-09T04:38:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feec40d1270 0x7feec415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feea806ace0 0x7feea806d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feec40b0240 0x7feec41579a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 --2- 172.21.15.26:0/4100096979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feec40ce6c0 0x7feec40b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 >> 172.21.15.26:0/4100096979 conn(0x7feec4089fc0 msgr2=0x7feec4158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:27.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 shutdown_connections 2023-06-09T04:38:27.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.046+0000 7feecbaa4700 1 -- 172.21.15.26:0/4100096979 wait complete. 2023-06-09T04:38:27.060 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:27.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.186+0000 7f6758a8a700 1 Processor -- start 2023-06-09T04:38:27.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.186+0000 7f6758a8a700 1 -- start start 2023-06-09T04:38:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.186+0000 7f6758a8a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f67540aed90 0x7f67540c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.186+0000 7f6758a8a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67540ca370 0x7f67540ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.186+0000 7f6758a8a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ceae0 0x7f67540cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.186+0000 7f6758a8a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540ca810 con 0x7f67540ca370 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6758a8a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540cda30 con 0x7f67540aed90 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6758a8a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6754159880 con 0x7f67540ceae0 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67540ca370 0x7f67540ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67540ca370 0x7f67540ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38302/0 (socket says 172.21.15.26:38302) 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 -- 172.21.15.26:0/3863081791 learned_addr learned my addr 172.21.15.26:0/3863081791 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f675259c700 1 --2- 172.21.15.26:0/3863081791 >> v2:172.21.15.104:3300/0 conn(0x7f67540aed90 0x7f67540c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6752d9d700 1 --2- 172.21.15.26:0/3863081791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ceae0 0x7f67540cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 -- 172.21.15.26:0/3863081791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ceae0 msgr2=0x7f67540cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 --2- 172.21.15.26:0/3863081791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ceae0 0x7f67540cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 -- 172.21.15.26:0/3863081791 >> v2:172.21.15.104:3300/0 conn(0x7f67540aed90 msgr2=0x7f67540c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 --2- 172.21.15.26:0/3863081791 >> v2:172.21.15.104:3300/0 conn(0x7f67540aed90 0x7f67540c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 -- 172.21.15.26:0/3863081791 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675406cff0 con 0x7f67540ca370 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f6751d9b700 1 --2- 172.21.15.26:0/3863081791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ca370 0x7f67540ce5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6754070e50 tx=0x7f674800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de7c8cf60c2ecde server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f675159a700 1 -- 172.21.15.26:0/3863081791 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800dd30 con 0x7f67540ca370 2023-06-09T04:38:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f675159a700 1 -- 172.21.15.26:0/3863081791 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674800de90 con 0x7f67540ca370 2023-06-09T04:38:27.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.187+0000 7f675159a700 1 -- 172.21.15.26:0/3863081791 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748010690 con 0x7f67540ca370 2023-06-09T04:38:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 -- 172.21.15.26:0/3863081791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ca370 msgr2=0x7f67540ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 --2- 172.21.15.26:0/3863081791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ca370 0x7f67540ce5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6754070e50 tx=0x7f674800be70 comp rx=0 tx=0).stop 2023-06-09T04:38:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 -- 172.21.15.26:0/3863081791 shutdown_connections 2023-06-09T04:38:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 --2- 172.21.15.26:0/3863081791 >> v2:172.21.15.104:3300/0 conn(0x7f67540aed90 0x7f67540c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 --2- 172.21.15.26:0/3863081791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ceae0 0x7f67540cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 --2- 172.21.15.26:0/3863081791 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ca370 0x7f67540ce5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 -- 172.21.15.26:0/3863081791 >> 172.21.15.26:0/3863081791 conn(0x7f6754098a30 msgr2=0x7f67540cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 -- 172.21.15.26:0/3863081791 shutdown_connections 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.188+0000 7f6758a8a700 1 -- 172.21.15.26:0/3863081791 wait complete. 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.189+0000 7f6758a8a700 1 Processor -- start 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.189+0000 7f6758a8a700 1 -- start start 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6758a8a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67540aed90 0x7f675406e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6758a8a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ca370 0x7f675414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6758a8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 0x7f67540c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6758a8a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540c7a40 con 0x7f67540ceae0 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6758a8a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540c6dc0 con 0x7f67540aed90 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6758a8a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540c70a0 con 0x7f67540ca370 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 0x7f67540c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 0x7f67540c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38312/0 (socket says 172.21.15.26:38312) 2023-06-09T04:38:27.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 -- 172.21.15.26:0/1337432208 learned_addr learned my addr 172.21.15.26:0/1337432208 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f675259c700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67540aed90 0x7f675406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6751d9b700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ca370 0x7f675414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 -- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ca370 msgr2=0x7f675414efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ca370 0x7f675414efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 -- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67540aed90 msgr2=0x7f675406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67540aed90 0x7f675406e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6752d9d700 1 -- 172.21.15.26:0/1337432208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674800b7f0 con 0x7f67540ceae0 2023-06-09T04:38:27.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f6751d9b700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ca370 0x7f675414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.190+0000 7f675259c700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67540aed90 0x7f675406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.191+0000 7f6752d9d700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 0x7f67540c7e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f674c007e40 tx=0x7f674c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.191+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c00eea0 con 0x7f67540ceae0 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.191+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c014420 con 0x7f67540ceae0 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.191+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67540c7380 con 0x7f67540ceae0 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.191+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0147b0 con 0x7f67540ceae0 2023-06-09T04:38:27.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.191+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675406e550 con 0x7f67540ceae0 2023-06-09T04:38:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.192+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675406e740 con 0x7f67540ceae0 2023-06-09T04:38:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.192+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f674c014910 con 0x7f67540ceae0 2023-06-09T04:38:27.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.193+0000 7f6742ffd700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f673406ace0 0x7f673406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.193+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f674c089cc0 con 0x7f67540ceae0 2023-06-09T04:38:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.193+0000 7f675259c700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f673406ace0 0x7f673406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.193+0000 7f675259c700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f673406ace0 0x7f673406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6744006fd0 tx=0x7f6744008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.197+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f674c054d70 con 0x7f67540ceae0 2023-06-09T04:38:27.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.395+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67540c7b80 con 0x7f67540ceae0 2023-06-09T04:38:27.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.395+0000 7f6742ffd700 1 -- 172.21.15.26:0/1337432208 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f674c058390 con 0x7f67540ceae0 2023-06-09T04:38:27.397 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:27.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.397+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f673406ace0 msgr2=0x7f673406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.397+0000 7f6758a8a700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f673406ace0 0x7f673406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6744006fd0 tx=0x7f6744008040 comp rx=0 tx=0).stop 2023-06-09T04:38:27.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.397+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 msgr2=0x7f67540c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.397+0000 7f6758a8a700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 0x7f67540c7e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f674c007e40 tx=0x7f674c00e3c0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 shutdown_connections 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f673406ace0 0x7f673406d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67540ceae0 0x7f67540c7e60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67540aed90 0x7f675406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 --2- 172.21.15.26:0/1337432208 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67540ca370 0x7f675414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 >> 172.21.15.26:0/1337432208 conn(0x7f6754098a30 msgr2=0x7f67540ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:27.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 shutdown_connections 2023-06-09T04:38:27.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.398+0000 7f6758a8a700 1 -- 172.21.15.26:0/1337432208 wait complete. 2023-06-09T04:38:27.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:27.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.533+0000 7f3569ed6700 1 Processor -- start 2023-06-09T04:38:27.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.533+0000 7f3569ed6700 1 -- start start 2023-06-09T04:38:27.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3569ed6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f35640cec00 0x7f35640caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3569ed6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35640cd600 0x7f356406aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3569ed6700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35640cc160 con 0x7f356415f9d0 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3569ed6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640cf240 con 0x7f35640cd600 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3569ed6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356415fda0 con 0x7f35640cec00 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35640cd600 0x7f356406aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35640cd600 0x7f356406aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38320/0 (socket says 172.21.15.26:38320) 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 -- 172.21.15.26:0/3163889582 learned_addr learned my addr 172.21.15.26:0/3163889582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:27.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3562ffd700 1 --2- 172.21.15.26:0/3163889582 >> v2:172.21.15.104:3300/0 conn(0x7f35640cec00 0x7f35640caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 -- 172.21.15.26:0/3163889582 >> v2:172.21.15.104:3300/0 conn(0x7f35640cec00 msgr2=0x7f35640caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 --2- 172.21.15.26:0/3163889582 >> v2:172.21.15.104:3300/0 conn(0x7f35640cec00 0x7f35640caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 -- 172.21.15.26:0/3163889582 >> v1:172.21.15.104:6789/0 conn(0x7f356415f9d0 legacy=0x7f35640ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3563fff700 1 -- 172.21.15.26:0/3163889582 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35640cb550 con 0x7f35640cd600 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.534+0000 7f3562ffd700 1 --2- 172.21.15.26:0/3163889582 >> v2:172.21.15.104:3300/0 conn(0x7f35640cec00 0x7f35640caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3563fff700 1 --2- 172.21.15.26:0/3163889582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35640cd600 0x7f356406aec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35640cefd0 tx=0x7f355c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb63c5ee194e146 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f35627fc700 1 -- 172.21.15.26:0/3163889582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00e070 con 0x7f35640cd600 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f35627fc700 1 -- 172.21.15.26:0/3163889582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c00b9c0 con 0x7f35640cd600 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f35627fc700 1 -- 172.21.15.26:0/3163889582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00bd70 con 0x7f35640cd600 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 -- 172.21.15.26:0/3163889582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35640cd600 msgr2=0x7f356406aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 --2- 172.21.15.26:0/3163889582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35640cd600 0x7f356406aec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35640cefd0 tx=0x7f355c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 -- 172.21.15.26:0/3163889582 shutdown_connections 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 --2- 172.21.15.26:0/3163889582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35640cd600 0x7f356406aec0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 --2- 172.21.15.26:0/3163889582 >> v2:172.21.15.104:3300/0 conn(0x7f35640cec00 0x7f35640caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 -- 172.21.15.26:0/3163889582 >> 172.21.15.26:0/3163889582 conn(0x7f3564089fc0 msgr2=0x7f35640d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:27.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 -- 172.21.15.26:0/3163889582 shutdown_connections 2023-06-09T04:38:27.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.535+0000 7f3569ed6700 1 -- 172.21.15.26:0/3163889582 wait complete. 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.536+0000 7f3569ed6700 1 Processor -- start 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 -- start start 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f35640cd600 0x7f35640c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f35640cec00 0x7f3564155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 0x7f356406b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356415c6e0 con 0x7f356415f9d0 2023-06-09T04:38:27.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564157030 con 0x7f35640cd600 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3569ed6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c9940 con 0x7f35640cec00 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3563fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 0x7f356406b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.537+0000 7f3563fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 0x7f356406b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38324/0 (socket says 172.21.15.26:38324) 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 -- 172.21.15.26:0/2335977479 learned_addr learned my addr 172.21.15.26:0/2335977479 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f35637fe700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f35640cd600 0x7f35640c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3562ffd700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f35640cec00 0x7f3564155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 -- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f35640cec00 msgr2=0x7f3564155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f35640cec00 0x7f3564155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 -- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f35640cd600 msgr2=0x7f35640c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f35640cd600 0x7f35640c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 -- 172.21.15.26:0/2335977479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009b30 con 0x7f356415f9d0 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3563fff700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 0x7f356406b1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f355c00b730 tx=0x7f355c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0099b0 con 0x7f356415f9d0 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0092e0 con 0x7f356415f9d0 2023-06-09T04:38:27.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35640ca2e0 con 0x7f356415f9d0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c01c640 con 0x7f356415f9d0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.538+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356415bd40 con 0x7f356415f9d0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.539+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35641571c0 con 0x7f356415f9d0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.540+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f355c01c7a0 con 0x7f356415f9d0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.540+0000 7f355bfff700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f354406ace0 0x7f354406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.540+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f355c08ae20 con 0x7f356415f9d0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.540+0000 7f35637fe700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f354406ace0 0x7f354406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.541+0000 7f35637fe700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f354406ace0 0x7f354406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3554000fb0 tx=0x7f3554009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.544+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f355c055f60 con 0x7f356415f9d0 2023-06-09T04:38:27.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.786+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35640d1620 con 0x7f356415f9d0 2023-06-09T04:38:27.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.786+0000 7f355bfff700 1 -- 172.21.15.26:0/2335977479 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f355c059580 con 0x7f356415f9d0 2023-06-09T04:38:27.788 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:27.788 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:27.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f354406ace0 msgr2=0x7f354406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f354406ace0 0x7f354406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3554000fb0 tx=0x7f3554009040 comp rx=0 tx=0).stop 2023-06-09T04:38:27.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 msgr2=0x7f356406b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 0x7f356406b1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f355c00b730 tx=0x7f355c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 shutdown_connections 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f354406ace0 0x7f354406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f356415f9d0 0x7f356406b1f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f35640cd600 0x7f35640c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 --2- 172.21.15.26:0/2335977479 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f35640cec00 0x7f3564155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.788+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 >> 172.21.15.26:0/2335977479 conn(0x7f3564089fc0 msgr2=0x7f35640b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.789+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 shutdown_connections 2023-06-09T04:38:27.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.789+0000 7f3569ed6700 1 -- 172.21.15.26:0/2335977479 wait complete. 2023-06-09T04:38:27.792 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:38:27.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:27.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.924+0000 7f0f49c50700 1 Processor -- start 2023-06-09T04:38:27.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.924+0000 7f0f49c50700 1 -- start start 2023-06-09T04:38:27.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f49c50700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44163f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f49c50700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f44159880 con 0x7f0f440ca540 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f49c50700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4406cff0 con 0x7f0f440aed90 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f49c50700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440cda30 con 0x7f0f4406ea70 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f42ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0f440ca540 0x7f0f440ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47190/0 (socket says 172.21.15.26:47190) 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f42ffd700 1 -- 172.21.15.26:0/24711443 learned_addr learned my addr 172.21.15.26:0/24711443 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f43fff700 1 --2- 172.21.15.26:0/24711443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931289561 0 0) 0x7f0f44159880 con 0x7f0f440ca540 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f300035b0 con 0x7f0f440ca540 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548619826 0 0) 0x7f0f4406cff0 con 0x7f0f440aed90 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f44159880 con 0x7f0f440aed90 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f43fff700 1 -- 172.21.15.26:0/24711443 >> v1:172.21.15.104:6789/0 conn(0x7f0f440aed90 legacy=0x7f0f440c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f43fff700 1 -- 172.21.15.26:0/24711443 >> v1:172.21.15.26:6789/0 conn(0x7f0f440ca540 legacy=0x7f0f440ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.925+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561742978 0 0) 0x7f0f300035b0 con 0x7f0f440ca540 2023-06-09T04:38:27.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f43fff700 1 -- 172.21.15.26:0/24711443 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440cf250 con 0x7f0f4406ea70 2023-06-09T04:38:27.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f43fff700 1 --2- 172.21.15.26:0/24711443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44163f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009dc0 tx=0x7f0f3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a110e350334ffc6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00e070 con 0x7f0f4406ea70 2023-06-09T04:38:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c003a20 con 0x7f0f4406ea70 2023-06-09T04:38:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f427fc700 1 -- 172.21.15.26:0/24711443 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c001670 con 0x7f0f4406ea70 2023-06-09T04:38:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f49c50700 1 -- 172.21.15.26:0/24711443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 msgr2=0x7f0f44163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f49c50700 1 --2- 172.21.15.26:0/24711443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44163f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009dc0 tx=0x7f0f3c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f49c50700 1 -- 172.21.15.26:0/24711443 shutdown_connections 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f49c50700 1 --2- 172.21.15.26:0/24711443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44163f90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.926+0000 7f0f49c50700 1 -- 172.21.15.26:0/24711443 >> 172.21.15.26:0/24711443 conn(0x7f0f44098a30 msgr2=0x7f0f440cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.927+0000 7f0f49c50700 1 -- 172.21.15.26:0/24711443 shutdown_connections 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.927+0000 7f0f49c50700 1 -- 172.21.15.26:0/24711443 wait complete. 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.928+0000 7f0f49c50700 1 Processor -- start 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.928+0000 7f0f49c50700 1 -- start start 2023-06-09T04:38:27.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 0x7f0f440c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f440ca540 0x7f0f44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440c54a0 con 0x7f0f440aed90 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f441576d0 con 0x7f0f440ca540 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440c45d0 con 0x7f0f4406ea70 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 0x7f0f440c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 0x7f0f440c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38338/0 (socket says 172.21.15.26:38338) 2023-06-09T04:38:27.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 -- 172.21.15.26:0/2874854738 learned_addr learned my addr 172.21.15.26:0/2874854738 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f43fff700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f440ca540 0x7f0f44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f437fe700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 -- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 msgr2=0x7f0f44157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 -- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f440ca540 msgr2=0x7f0f44069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f440ca540 0x7f0f44069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 -- 172.21.15.26:0/2874854738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c009a70 con 0x7f0f440aed90 2023-06-09T04:38:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f437fe700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f42ffd700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 0x7f0f440c8c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c6d0 tx=0x7f0f2c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c004c80 con 0x7f0f440aed90 2023-06-09T04:38:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c004de0 con 0x7f0f440aed90 2023-06-09T04:38:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f440c4820 con 0x7f0f440aed90 2023-06-09T04:38:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0072f0 con 0x7f0f440aed90 2023-06-09T04:38:27.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.929+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f440c4de0 con 0x7f0f440aed90 2023-06-09T04:38:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.930+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f44067180 con 0x7f0f440aed90 2023-06-09T04:38:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.931+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f2c007450 con 0x7f0f440aed90 2023-06-09T04:38:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.931+0000 7f0f3bfff700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0f2406ace0 0x7f0f2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.931+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f2c089200 con 0x7f0f440aed90 2023-06-09T04:38:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.931+0000 7f0f437fe700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0f2406ace0 0x7f0f2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.932+0000 7f0f437fe700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0f2406ace0 0x7f0f2406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f34001230 tx=0x7f0f34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:27.935+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f2c057dd0 con 0x7f0f440aed90 2023-06-09T04:38:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.134+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f440b1910 con 0x7f0f440aed90 2023-06-09T04:38:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.135+0000 7f0f3bfff700 1 -- 172.21.15.26:0/2874854738 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f0f2c0019a0 con 0x7f0f440aed90 2023-06-09T04:38:28.137 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:28.137 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:28.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0f2406ace0 msgr2=0x7f0f2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0f2406ace0 0x7f0f2406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f34001230 tx=0x7f0f34009040 comp rx=0 tx=0).stop 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 msgr2=0x7f0f440c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 0x7f0f440c8c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c6d0 tx=0x7f0f2c00ca90 comp rx=0 tx=0).stop 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 shutdown_connections 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f440ca540 0x7f0f44069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0f4406ea70 0x7f0f44157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0f2406ace0 0x7f0f2406d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 --2- 172.21.15.26:0/2874854738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f440aed90 0x7f0f440c8c20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 >> 172.21.15.26:0/2874854738 conn(0x7f0f44098a30 msgr2=0x7f0f440cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:28.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.137+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 shutdown_connections 2023-06-09T04:38:28.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.138+0000 7f0f49c50700 1 -- 172.21.15.26:0/2874854738 wait complete. 2023-06-09T04:38:28.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.274+0000 7fd627070700 1 Processor -- start 2023-06-09T04:38:28.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.274+0000 7fd627070700 1 -- start start 2023-06-09T04:38:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd627070700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd62015a340 0x7fd6200b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd627070700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6200b0850 0x7fd6200ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd627070700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6200d08b0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd627070700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200cee70 con 0x7fd62015a340 2023-06-09T04:38:28.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd627070700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62015a710 con 0x7fd6200b0850 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd624e0c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd62015a340 0x7fd6200b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd624e0c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd62015a340 0x7fd6200b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38344/0 (socket says 172.21.15.26:38344) 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.275+0000 7fd624e0c700 1 -- 172.21.15.26:0/251099177 learned_addr learned my addr 172.21.15.26:0/251099177 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd62560d700 1 --2- 172.21.15.26:0/251099177 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6200b0850 0x7fd6200ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd624e0c700 1 -- 172.21.15.26:0/251099177 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6200b0850 msgr2=0x7fd6200ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd624e0c700 1 --2- 172.21.15.26:0/251099177 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6200b0850 0x7fd6200ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd624e0c700 1 -- 172.21.15.26:0/251099177 >> v1:172.21.15.104:6789/0 conn(0x7fd6200ce4b0 legacy=0x7fd6200b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd624e0c700 1 -- 172.21.15.26:0/251099177 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200b0d20 con 0x7fd62015a340 2023-06-09T04:38:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd624e0c700 1 --2- 172.21.15.26:0/251099177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62015a340 0x7fd6200b1dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd614006fd0 tx=0x7fd614009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55d51aa0dc64ff4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd61f7fe700 1 -- 172.21.15.26:0/251099177 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614005e30 con 0x7fd62015a340 2023-06-09T04:38:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd61f7fe700 1 -- 172.21.15.26:0/251099177 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd614004030 con 0x7fd62015a340 2023-06-09T04:38:28.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd61f7fe700 1 -- 172.21.15.26:0/251099177 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6140043e0 con 0x7fd62015a340 2023-06-09T04:38:28.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd627070700 1 -- 172.21.15.26:0/251099177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62015a340 msgr2=0x7fd6200b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd627070700 1 --2- 172.21.15.26:0/251099177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62015a340 0x7fd6200b1dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd614006fd0 tx=0x7fd614009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd627070700 1 -- 172.21.15.26:0/251099177 shutdown_connections 2023-06-09T04:38:28.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd627070700 1 --2- 172.21.15.26:0/251099177 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6200b0850 0x7fd6200ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd627070700 1 --2- 172.21.15.26:0/251099177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62015a340 0x7fd6200b1dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.276+0000 7fd627070700 1 -- 172.21.15.26:0/251099177 >> 172.21.15.26:0/251099177 conn(0x7fd620089fc0 msgr2=0x7fd62008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.277+0000 7fd627070700 1 -- 172.21.15.26:0/251099177 shutdown_connections 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.277+0000 7fd627070700 1 -- 172.21.15.26:0/251099177 wait complete. 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.278+0000 7fd627070700 1 Processor -- start 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.278+0000 7fd627070700 1 -- start start 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6200b0850 0x7fd6200b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:28.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 0x7fd6201ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd62015a340 0x7fd6201e0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201522f0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62014b660 con 0x7fd6200b0850 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201efaf0 con 0x7fd62015a340 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 0x7fd6201ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 0x7fd6201ef5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38352/0 (socket says 172.21.15.26:38352) 2023-06-09T04:38:28.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 -- 172.21.15.26:0/1722621869 learned_addr learned my addr 172.21.15.26:0/1722621869 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd624e0c700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6200b0850 0x7fd6200b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd62560d700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd62015a340 0x7fd6201e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 -- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd62015a340 msgr2=0x7fd6201e0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd62015a340 0x7fd6201e0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 -- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6200b0850 msgr2=0x7fd6200b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6200b0850 0x7fd6200b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 -- 172.21.15.26:0/1722621869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614009500 con 0x7fd6200ce4b0 2023-06-09T04:38:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61ffff700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 0x7fd6201ef5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00c510 tx=0x7fd60c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0052d0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c005430 con 0x7fd6200ce4b0 2023-06-09T04:38:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0038c0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.279+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6200ae8a0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.280+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6200aee60 con 0x7fd6200ce4b0 2023-06-09T04:38:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.280+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6201593a0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.281+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd60c003a20 con 0x7fd6200ce4b0 2023-06-09T04:38:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.281+0000 7fd61d7fa700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd60406ace0 0x7fd60406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:28.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.281+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd60c0887c0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.282+0000 7fd624e0c700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd60406ace0 0x7fd60406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.282+0000 7fd624e0c700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd60406ace0 0x7fd60406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd614000c00 tx=0x7fd614008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:28.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.286+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd60c053870 con 0x7fd6200ce4b0 2023-06-09T04:38:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.529+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6201590c0 con 0x7fd6200ce4b0 2023-06-09T04:38:28.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.530+0000 7fd61d7fa700 1 -- 172.21.15.26:0/1722621869 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fd60c056e90 con 0x7fd6200ce4b0 2023-06-09T04:38:28.531 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:28.531 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.531+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd60406ace0 msgr2=0x7fd60406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.531+0000 7fd627070700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd60406ace0 0x7fd60406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd614000c00 tx=0x7fd614008070 comp rx=0 tx=0).stop 2023-06-09T04:38:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.531+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 msgr2=0x7fd6201ef5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.531+0000 7fd627070700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 0x7fd6201ef5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00c510 tx=0x7fd60c00c820 comp rx=0 tx=0).stop 2023-06-09T04:38:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 shutdown_connections 2023-06-09T04:38:28.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd62015a340 0x7fd6201e0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6200b0850 0x7fd6200b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd60406ace0 0x7fd60406d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 --2- 172.21.15.26:0/1722621869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ce4b0 0x7fd6201ef5b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 >> 172.21.15.26:0/1722621869 conn(0x7fd620089fc0 msgr2=0x7fd6200af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 shutdown_connections 2023-06-09T04:38:28.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:28.532+0000 7fd627070700 1 -- 172.21.15.26:0/1722621869 wait complete. 2023-06-09T04:38:28.535 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:38:28.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:38:10.903661+0000', 'modified': '2023-06-09T04:38:13.919504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6837/2737305300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6836', 'nonce': 2737305300}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 2737305300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:38:28.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:38:28.948 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-09T04:38:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 Processor -- start 2023-06-09T04:38:29.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 -- start start 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f067406ea90 0x7f06740ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06740b2130 con 0x7f06740aeb20 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06740aef90 con 0x7f067406ea90 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067bd19700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067406a9c0 con 0x7f067415c620 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f06792b4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f06740aeb20 0x7f067406e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47216/0 (socket says 172.21.15.26:47216) 2023-06-09T04:38:29.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f06792b4700 1 -- 172.21.15.26:0/2004163244 learned_addr learned my addr 172.21.15.26:0/2004163244 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f0679ab5700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f067a2b6700 1 --2- 172.21.15.26:0/2004163244 >> v2:172.21.15.104:3300/0 conn(0x7f067406ea90 0x7f06740ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f0678ab3700 1 -- 172.21.15.26:0/2004163244 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561776295 0 0) 0x7f06740b2130 con 0x7f06740aeb20 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.077+0000 7f0678ab3700 1 -- 172.21.15.26:0/2004163244 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06600035b0 con 0x7f06740aeb20 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067a2b6700 1 -- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 msgr2=0x7f06740ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067a2b6700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f0678ab3700 1 -- 172.21.15.26:0/2004163244 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175174314 0 0) 0x7f06600035b0 con 0x7f06740aeb20 2023-06-09T04:38:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067a2b6700 1 -- 172.21.15.26:0/2004163244 >> v1:172.21.15.26:6789/0 conn(0x7f06740aeb20 legacy=0x7f067406e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067a2b6700 1 -- 172.21.15.26:0/2004163244 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740ac3b0 con 0x7f067406ea90 2023-06-09T04:38:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f0679ab5700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:29.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067a2b6700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f067406ea90 0x7f06740ce440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f066c009d90 tx=0x7f066c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=123d71cab70068f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f0678ab3700 1 -- 172.21.15.26:0/2004163244 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00e070 con 0x7f067406ea90 2023-06-09T04:38:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f0678ab3700 1 -- 172.21.15.26:0/2004163244 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c003a20 con 0x7f067406ea90 2023-06-09T04:38:29.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f0678ab3700 1 -- 172.21.15.26:0/2004163244 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670001670 con 0x7f067406ea90 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067bd19700 1 -- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f067406ea90 msgr2=0x7f06740ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067bd19700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f067406ea90 0x7f06740ce440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f066c009d90 tx=0x7f066c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.078+0000 7f067bd19700 1 -- 172.21.15.26:0/2004163244 shutdown_connections 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.079+0000 7f067bd19700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f067406ea90 0x7f06740ce440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.079+0000 7f067bd19700 1 --2- 172.21.15.26:0/2004163244 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.079+0000 7f067bd19700 1 -- 172.21.15.26:0/2004163244 >> 172.21.15.26:0/2004163244 conn(0x7f0674098b50 msgr2=0x7f06740cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.079+0000 7f067bd19700 1 -- 172.21.15.26:0/2004163244 shutdown_connections 2023-06-09T04:38:29.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.079+0000 7f067bd19700 1 -- 172.21.15.26:0/2004163244 wait complete. 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.080+0000 7f067bd19700 1 Processor -- start 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.080+0000 7f067bd19700 1 -- start start 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 0x7f0674157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06740aeb20 0x7f06740ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0674158d80 con 0x7f067406ea90 2023-06-09T04:38:29.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06741583b0 con 0x7f06740aeb20 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06740cb840 con 0x7f067415c620 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 0x7f0674157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 0x7f0674157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38364/0 (socket says 172.21.15.26:38364) 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 -- 172.21.15.26:0/678276708 learned_addr learned my addr 172.21.15.26:0/678276708 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067a2b6700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 -- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 msgr2=0x7f06740ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f06792b4700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06740aeb20 0x7f06740ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 -- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06740aeb20 msgr2=0x7f06740ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06740aeb20 0x7f06740ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 -- 172.21.15.26:0/678276708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664009430 con 0x7f067406ea90 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f0679ab5700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 0x7f0674157e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f066400ebe0 tx=0x7f0664009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f066a7fc700 1 -- 172.21.15.26:0/678276708 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664005a20 con 0x7f067406ea90 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f066a7fc700 1 -- 172.21.15.26:0/678276708 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0664005b80 con 0x7f067406ea90 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c009a70 con 0x7f067406ea90 2023-06-09T04:38:29.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f066a7fc700 1 -- 172.21.15.26:0/678276708 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400c910 con 0x7f067406ea90 2023-06-09T04:38:29.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.081+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0674158a10 con 0x7f067406ea90 2023-06-09T04:38:29.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.083+0000 7f066a7fc700 1 -- 172.21.15.26:0/678276708 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f066400ca70 con 0x7f067406ea90 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.083+0000 7f066a7fc700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f065806ace0 0x7f065806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.083+0000 7f066a7fc700 1 -- 172.21.15.26:0/678276708 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0664089820 con 0x7f067406ea90 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.083+0000 7f06792b4700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f065806ace0 0x7f065806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.084+0000 7f06792b4700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f065806ace0 0x7f065806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06700011e0 tx=0x7f0670009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.085+0000 7f0687e9eb80 1 Processor -- start 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.085+0000 7f0687e9eb80 1 -- start start 2023-06-09T04:38:29.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934be310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 0x560f934c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f9350c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f933c83b0 con 0x560f934c26c0 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f933c9c60 con 0x560f934c22f0 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f9341c570 con 0x560f9350bc70 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 0x560f934c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 0x560f934c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38374/0 (socket says 172.21.15.26:38374) 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 -- 172.21.15.26:0/2413044554 learned_addr learned my addr 172.21.15.26:0/2413044554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f0679ab5700 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f067a2b6700 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f9350c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 -- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 msgr2=0x560f9350c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f9350c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 -- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 msgr2=0x560f934be310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934be310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.086+0000 7f06792b4700 1 -- 172.21.15.26:0/2413044554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f93243d90 con 0x560f934c26c0 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f06792b4700 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 0x560f934c2b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0670005bd0 tx=0x7f0670010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56477a61044a6223 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f06577fe700 1 -- 172.21.15.26:0/2413044554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067000d850 con 0x560f934c26c0 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f06577fe700 1 -- 172.21.15.26:0/2413044554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067000d9b0 con 0x560f934c26c0 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f06577fe700 1 -- 172.21.15.26:0/2413044554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067000dd60 con 0x560f934c26c0 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2413044554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 msgr2=0x560f934c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 0x560f934c2b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0670005bd0 tx=0x7f0670010000 comp rx=0 tx=0).stop 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2413044554 shutdown_connections 2023-06-09T04:38:29.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f9350c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2413044554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c26c0 0x560f934c2b30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2413044554 >> 172.21.15.26:0/2413044554 conn(0x560f934c0ce0 msgr2=0x560f935094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.087+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2413044554 shutdown_connections 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.088+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2413044554 wait complete. 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.088+0000 7f0687e9eb80 1 -- start start 2023-06-09T04:38:29.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.088+0000 7f0687e9eb80 1 Processor -- start 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f934e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f93505d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f93503a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f93415a00 con 0x560f934c22f0 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f933b5a70 con 0x560f934c26c0 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f933b5770 con 0x560f9350bc70 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f934e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0687e9eb80 10 client.0 _ll_register_callbacks cb 0x560f933b3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f934e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38378/0 (socket says 172.21.15.26:38378) 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 -- 172.21.15.26:0/2925002490 learned_addr learned my addr 172.21.15.26:0/2925002490 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f067a2b6700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f93503a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f06792b4700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f93505d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 -- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 msgr2=0x560f93503a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f93503a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 -- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 msgr2=0x560f93505d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f93505d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.089+0000 7f0679ab5700 1 -- 172.21.15.26:0/2925002490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0670005880 con 0x560f934c22f0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0679ab5700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f934e6fe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06640603b0 tx=0x7f0664060a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cb925c9ac10cf3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0654ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0654ff9700 1 -- 172.21.15.26:0/2925002490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664057ce0 con 0x560f934c22f0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0654ff9700 1 -- 172.21.15.26:0/2925002490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f066406d070 con 0x560f934c22f0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f934b6850 con 0x560f934c22f0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0654ff9700 1 -- 172.21.15.26:0/2925002490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0664060450 con 0x560f934c22f0 2023-06-09T04:38:29.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 10 client.4647 fetch_fsmap learned FSMap version 8 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560f9322cc10 con 0x560f934c22f0 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0654ff9700 1 -- 172.21.15.26:0/2925002490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0664073030 con 0x560f934c22f0 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0654ff9700 1 -- 172.21.15.26:0/2925002490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f066405e0b0 con 0x560f934c22f0 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 20 client.4647 populate_metadata read hostname 'smithi026' 2023-06-09T04:38:29.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934ed680 0x560f934eda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 4 client.4647 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:38:29.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 --> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f9340e9e0 con 0x560f934ed680 2023-06-09T04:38:29.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.090+0000 7f06792b4700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934ed680 0x560f934eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.091+0000 7f0654ff9700 10 client.4647 ms_handle_connect on v2:172.21.15.104:6836/2737305300 2023-06-09T04:38:29.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.091+0000 7f06792b4700 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934ed680 0x560f934eda50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb36754d7bebc84 server_cookie=7ccd7f8e3bae92f4 in_seq=0 out_seq=0 2023-06-09T04:38:29.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0654ff9700 1 -- 172.21.15.26:0/2925002490 <== mds.0 v2:172.21.15.104:6836/2737305300 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560f9340e9e0 con 0x560f934ed680 2023-06-09T04:38:29.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0654ff9700 10 client.4647 handle_command_reply: tid=0 2023-06-09T04:38:29.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 client.4647 shutdown 2023-06-09T04:38:29.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 msgr2=0x560f934e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f934e6fe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06640603b0 tx=0x7f0664060a10 comp rx=0 tx=0).stop 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 shutdown_connections 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934ed680 0x560f934eda50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f93503a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f934e6fe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0654ff9700 0 client.4647 ms_handle_reset on v2:172.21.15.104:6836/2737305300 2023-06-09T04:38:29.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/2925002490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f93505d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 >> 172.21.15.26:0/2925002490 conn(0x560f934c0ce0 msgr2=0x560f934beba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 shutdown_connections 2023-06-09T04:38:29.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 1 -- 172.21.15.26:0/2925002490 wait complete. 2023-06-09T04:38:29.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.092+0000 7f0687e9eb80 20 client.4647 trim_cache size 0 max 16384 2023-06-09T04:38:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.110+0000 7f0687e9eb80 1 Processor -- start 2023-06-09T04:38:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.110+0000 7f0687e9eb80 1 -- start start 2023-06-09T04:38:29.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f934c26c0 0x560f934be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 0x560f934bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f932998d0 con 0x560f9350bc70 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f93522b90 con 0x560f934c22f0 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f934b65e0 con 0x560f934c26c0 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 0x560f934bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 0x560f934bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38390/0 (socket says 172.21.15.26:38390) 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 -- 172.21.15.26:0/3936083866 learned_addr learned my addr 172.21.15.26:0/3936083866 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0679ab5700 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f06792b4700 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f934c26c0 0x560f934be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 -- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f934c26c0 msgr2=0x560f934be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f934c26c0 0x560f934be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 -- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 msgr2=0x560f934eadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934eadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 -- 172.21.15.26:0/3936083866 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f9326a200 con 0x560f9350bc70 2023-06-09T04:38:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f067a2b6700 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 0x560f934bee20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f067406c150 tx=0x7f066c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601ca75471ea051c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0657fff700 1 -- 172.21.15.26:0/3936083866 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c003e90 con 0x560f9350bc70 2023-06-09T04:38:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0657fff700 1 -- 172.21.15.26:0/3936083866 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c022070 con 0x560f9350bc70 2023-06-09T04:38:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.111+0000 7f0657fff700 1 -- 172.21.15.26:0/3936083866 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00bc20 con 0x560f9350bc70 2023-06-09T04:38:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 -- 172.21.15.26:0/3936083866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 msgr2=0x560f934bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 0x560f934bee20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f067406c150 tx=0x7f066c010000 comp rx=0 tx=0).stop 2023-06-09T04:38:29.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 -- 172.21.15.26:0/3936083866 shutdown_connections 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f9350bc70 0x560f934bee20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c22f0 0x560f934eadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/3936083866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f934c26c0 0x560f934be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 -- 172.21.15.26:0/3936083866 >> 172.21.15.26:0/3936083866 conn(0x560f934c0ce0 msgr2=0x560f934be040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 -- 172.21.15.26:0/3936083866 shutdown_connections 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 -- 172.21.15.26:0/3936083866 wait complete. 2023-06-09T04:38:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.112+0000 7f0687e9eb80 1 -- start start 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 Processor -- start 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f9355a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f934eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f934eb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f9350ce60 con 0x560f934c22f0 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f935722d0 con 0x560f934c26c0 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.113+0000 7f0687e9eb80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f934ed430 con 0x560f9350bc70 2023-06-09T04:38:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0687e9eb80 10 client.0 _ll_register_callbacks cb 0x560f933b3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f9355a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f9355a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38392/0 (socket says 172.21.15.26:38392) 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 -- 172.21.15.26:0/1001510656 learned_addr learned my addr 172.21.15.26:0/1001510656 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f067a2b6700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f934eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f06792b4700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f934eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 -- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 msgr2=0x560f934eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f934eb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 -- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 msgr2=0x560f934eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f934eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 -- 172.21.15.26:0/1001510656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06740ac3b0 con 0x560f934c22f0 2023-06-09T04:38:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0679ab5700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f9355a1c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06640568e0 tx=0x7f0664087ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02235022b06be8f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0654ff9700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-06-09T04:38:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0654ff9700 1 -- 172.21.15.26:0/1001510656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664060450 con 0x560f934c22f0 2023-06-09T04:38:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0654ff9700 1 -- 172.21.15.26:0/1001510656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f066406d040 con 0x560f934c22f0 2023-06-09T04:38:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f067000d9b0 con 0x560f934c22f0 2023-06-09T04:38:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0654ff9700 1 -- 172.21.15.26:0/1001510656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06640569e0 con 0x560f934c22f0 2023-06-09T04:38:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0687e9eb80 10 client.4653 fetch_fsmap learned FSMap version 8 2023-06-09T04:38:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560f93242260 con 0x560f934c22f0 2023-06-09T04:38:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0654ff9700 1 -- 172.21.15.26:0/1001510656 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067000d9b0 con 0x560f934c22f0 2023-06-09T04:38:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.114+0000 7f0654ff9700 1 -- 172.21.15.26:0/1001510656 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0664078070 con 0x560f934c22f0 2023-06-09T04:38:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T04:38:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:38:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 20 client.4653 populate_metadata read hostname 'smithi026' 2023-06-09T04:38:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934fefe0 0x560f934ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 4 client.4653 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-06-09T04:38:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 --> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560f933d1000 con 0x560f934fefe0 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f06792b4700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934fefe0 0x560f934ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0654ff9700 10 client.4653 ms_handle_connect on v2:172.21.15.104:6836/2737305300 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f06792b4700 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934fefe0 0x560f934ff3b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b40ac4338eb4b3 server_cookie=4adac3e8157dac71 in_seq=0 out_seq=0 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0654ff9700 1 -- 172.21.15.26:0/1001510656 <== mds.0 v2:172.21.15.104:6836/2737305300 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x560f933d1000 con 0x560f934fefe0 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0654ff9700 10 client.4653 handle_command_reply: tid=0 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 1 client.4653 shutdown 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 msgr2=0x560f9355a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.115+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f9355a1c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06640568e0 tx=0x7f0664087ac0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 shutdown_connections 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:6836/2737305300,v1:172.21.15.104:6837/2737305300] conn(0x560f934fefe0 0x560f934ff3b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x560f9350bc70 0x560f934eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f934c22f0 0x560f9355a1c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0654ff9700 0 client.4653 ms_handle_reset on v2:172.21.15.104:6836/2737305300 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 --2- 172.21.15.26:0/1001510656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560f934c26c0 0x560f934eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 >> 172.21.15.26:0/1001510656 conn(0x560f934c0ce0 msgr2=0x560f934be040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 shutdown_connections 2023-06-09T04:38:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 1 -- 172.21.15.26:0/1001510656 wait complete. 2023-06-09T04:38:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f0687e9eb80 20 client.4653 trim_cache size 0 max 16384 2023-06-09T04:38:29.128 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-06-09T04:38:29.128 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d8ea66dc-572e-4c93-a618-c44f62bf95ff", 2023-06-09T04:38:29.128 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4300, 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 18.211038192, 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2023-06-09T04:38:29.129 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 21, 2023-06-09T04:38:29.130 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 21, 2023-06-09T04:38:29.130 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 23.599302349999999 2023-06-09T04:38:29.130 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-06-09T04:38:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f065806ace0 msgr2=0x7f065806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f065806ace0 0x7f065806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06700011e0 tx=0x7f0670009040 comp rx=0 tx=0).stop 2023-06-09T04:38:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 msgr2=0x7f0674157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 0x7f0674157e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f066400ebe0 tx=0x7f0664009ea0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 shutdown_connections 2023-06-09T04:38:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f067415c620 0x7f06740ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f065806ace0 0x7f065806d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f067406ea90 0x7f0674157e70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 --2- 172.21.15.26:0/678276708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06740aeb20 0x7f06740ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 >> 172.21.15.26:0/678276708 conn(0x7f0674098b50 msgr2=0x7f06740ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 shutdown_connections 2023-06-09T04:38:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.116+0000 7f067bd19700 1 -- 172.21.15.26:0/678276708 wait complete. 2023-06-09T04:38:29.133 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-06-09T04:38:29.155 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-06-09T04:38:29.156 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-09T04:38:29.156 INFO:tasks.ceph_fuse:client.0 config is {} 2023-06-09T04:38:29.156 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:29.157 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:29.157 INFO:tasks.ceph_fuse:client.2 config is {} 2023-06-09T04:38:29.157 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:29.158 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:29.158 INFO:tasks.ceph_fuse:client.1 config is {} 2023-06-09T04:38:29.158 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:29.158 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:29.158 INFO:tasks.ceph_fuse:client.3 config is {} 2023-06-09T04:38:29.158 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:29.159 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:29.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.159 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2023-06-09T04:38:29.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.181 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2023-06-09T04:38:29.255 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2023-06-09T04:38:29.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:38:29.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.257 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-06-09T04:38:29.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-06-09T04:38:29.344 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-06-09T04:38:29.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:38:29.346 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-06-09T04:38:29.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.510+0000 7f46aa196700 1 Processor -- start 2023-06-09T04:38:29.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.510+0000 7f46aa196700 1 -- start start 2023-06-09T04:38:29.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46aa196700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 0x7f46a415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46aa196700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 0x7f46a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46aa196700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a406e100 con 0x7f46a415a380 2023-06-09T04:38:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46aa196700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a406e3e0 con 0x7f46a40710d0 2023-06-09T04:38:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46aa196700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415dd10 con 0x7f46a406b1a0 2023-06-09T04:38:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 0x7f46a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a2ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 0x7f46a415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 0x7f46a4069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:49062/0 (socket says 172.21.15.26:49062) 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a2ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 0x7f46a415e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:45522/0 (socket says 172.21.15.26:45522) 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 -- 172.21.15.26:0/957187101 learned_addr learned my addr 172.21.15.26:0/957187101 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a37fe700 1 --1- 172.21.15.26:0/957187101 >> v1:172.21.15.104:6789/0 conn(0x7f46a415a380 0x7f46a40709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:46170/0 (socket says 172.21.15.26:46170) 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 -- 172.21.15.26:0/957187101 >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 msgr2=0x7f46a415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 --2- 172.21.15.26:0/957187101 >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 0x7f46a415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 -- 172.21.15.26:0/957187101 >> v1:172.21.15.104:6789/0 conn(0x7f46a415a380 legacy=0x7f46a40709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a27fc700 1 -- 172.21.15.26:0/957187101 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064757788 0 0) 0x7f46a406e100 con 0x7f46a415a380 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 -- 172.21.15.26:0/957187101 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a415dff0 con 0x7f46a406b1a0 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a2ffd700 1 --2- 172.21.15.26:0/957187101 >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 0x7f46a415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a3fff700 1 --2- 172.21.15.26:0/957187101 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 0x7f46a4069db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f469c009e50 tx=0x7f469c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79dfa770ad594dd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a27fc700 1 -- 172.21.15.26:0/957187101 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00e070 con 0x7f46a406b1a0 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a27fc700 1 -- 172.21.15.26:0/957187101 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00b910 con 0x7f46a406b1a0 2023-06-09T04:38:29.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.511+0000 7f46a27fc700 1 -- 172.21.15.26:0/957187101 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00bcc0 con 0x7f46a406b1a0 2023-06-09T04:38:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 -- 172.21.15.26:0/957187101 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 msgr2=0x7f46a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 --2- 172.21.15.26:0/957187101 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 0x7f46a4069db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f469c009e50 tx=0x7f469c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 -- 172.21.15.26:0/957187101 shutdown_connections 2023-06-09T04:38:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 --2- 172.21.15.26:0/957187101 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a406b1a0 0x7f46a4069db0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 --2- 172.21.15.26:0/957187101 >> v2:172.21.15.104:3300/0 conn(0x7f46a40710d0 0x7f46a415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 -- 172.21.15.26:0/957187101 >> 172.21.15.26:0/957187101 conn(0x7f46a40cb9d0 msgr2=0x7f46a40cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 -- 172.21.15.26:0/957187101 shutdown_connections 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.512+0000 7f46aa196700 1 -- 172.21.15.26:0/957187101 wait complete. 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.513+0000 7f46aa196700 1 Processor -- start 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.513+0000 7f46aa196700 1 -- start start 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46aa196700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46a406b1a0 0x7f46a40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46aa196700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a40710d0 0x7f46a40c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46aa196700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 0x7f46a40b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46aa196700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c6a60 con 0x7f46a415a380 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46aa196700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c8f30 con 0x7f46a406b1a0 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46aa196700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c5040 con 0x7f46a40710d0 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46a3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 0x7f46a40b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46a3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 0x7f46a40b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38410/0 (socket says 172.21.15.26:38410) 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46a3fff700 1 -- 172.21.15.26:0/1208598562 learned_addr learned my addr 172.21.15.26:0/1208598562 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:29.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46a37fe700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46a406b1a0 0x7f46a40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.514+0000 7f46a2ffd700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a40710d0 0x7f46a40c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46a3fff700 1 -- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a40710d0 msgr2=0x7f46a40c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46a3fff700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a40710d0 0x7f46a40c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46a3fff700 1 -- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46a406b1a0 msgr2=0x7f46a40c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46a3fff700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46a406b1a0 0x7f46a40c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46a3fff700 1 -- 172.21.15.26:0/1208598562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980094a0 con 0x7f46a415a380 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46a3fff700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 0x7f46a40b0440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f46a415de50 tx=0x7f469c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c003ea0 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c0048e0 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c01c680 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c009b30 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.515+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40c3c30 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.516+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a40c6bd0 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.516+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f469c01c7e0 con 0x7f46a415a380 2023-06-09T04:38:29.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.517+0000 7f468bfff700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f469006ace0 0x7f469006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.517+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f469c08b000 con 0x7f46a415a380 2023-06-09T04:38:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.517+0000 7f46a37fe700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f469006ace0 0x7f469006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.517+0000 7f46a37fe700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f469006ace0 0x7f469006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4694000f60 tx=0x7f4694004a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:29.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.522+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f469c056140 con 0x7f46a415a380 2023-06-09T04:38:29.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.762+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46a4067180 con 0x7f46a415a380 2023-06-09T04:38:29.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.763+0000 7f468bfff700 1 -- 172.21.15.26:0/1208598562 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f469c059760 con 0x7f46a415a380 2023-06-09T04:38:29.764 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:38:29.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f469006ace0 msgr2=0x7f469006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f469006ace0 0x7f469006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4694000f60 tx=0x7f4694004a50 comp rx=0 tx=0).stop 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 msgr2=0x7f46a40b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 0x7f46a40b0440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f46a415de50 tx=0x7f469c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 shutdown_connections 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f469006ace0 0x7f469006d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f46a415a380 0x7f46a40b0440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46a406b1a0 0x7f46a40c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 --2- 172.21.15.26:0/1208598562 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f46a40710d0 0x7f46a40c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:29.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 >> 172.21.15.26:0/1208598562 conn(0x7f46a40cb9d0 msgr2=0x7f46a415bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:29.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 shutdown_connections 2023-06-09T04:38:29.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:29.765+0000 7f46aa196700 1 -- 172.21.15.26:0/1208598562 wait complete. 2023-06-09T04:38:29.778 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:29.778 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:29.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-06-09T04:38:29.779 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:38:29.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:29.779 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:29.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:29.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:29.780 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:29.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.780 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-06-09T04:38:29.797 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:29.797 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:29.797 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:29.798 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42117sec preferred_lft 42117sec 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:29.799 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:29.800 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:38:29.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.800 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:29.801 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:29.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:38:29.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-06-09T04:38:29.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-06-09T04:38:29.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:38:29.802 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:29.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:29.974 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:30.002 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-06-09T04:38:30.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.004 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-06-09T04:38:30.079 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-06-09T04:38:30.080 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:30.080 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-09T04:38:30.080 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-09T04:38:30.080 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:30.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.081 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:30.081 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:30.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:38:30.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:38:30.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:38:30.082 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:30.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.337 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-06-09T04:38:30.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.354 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-06-09T04:38:30.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.410 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:30.411 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:30.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:38:30.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-09T04:38:30.411 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:30.506 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-09T04:38:30.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.506 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:30.507 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:30.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-09T04:38:30.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:30.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-09T04:38:30.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-09T04:38:30.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-09T04:38:30.508 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:30.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:30.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:30.713 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:30.713 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-06-09T04:38:30.713 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:38:30.713 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:30.821 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-09T04:38:30.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:30.821 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:30.841 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:30.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:30.842 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:30.897 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-06-09T04:38:30.963 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:30.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:31.030 INFO:teuthology.orchestra.run.smithi026.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:31.031 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:31.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:31.032 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-06-09T04:38:31.088 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:38:31.088 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-09T04:38:31.131 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-06-09T04:38:31.158 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:31.159 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:31.224 INFO:teuthology.orchestra.run.smithi026.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:31.226 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:31.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:31.226 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-06-09T04:38:31.247 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-06-09T04:38:31.247+0000 7f97524c05c0 -1 init, newargv = 0x5625b58dadd0 newargc=15 2023-06-09T04:38:31.247 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[139557]: starting ceph client 2023-06-09T04:38:31.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[139557]: starting fuse 2023-06-09T04:38:31.264 INFO:teuthology.orchestra.run.smithi026.stdout:47 2023-06-09T04:38:31.264 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-06-09T04:38:31.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:31.265 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-06-09T04:38:31.265 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-06-09T04:38:31.265 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-06-09T04:38:31.265 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-06-09T04:38:31.266 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:31.266 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-06-09T04:38:31.266 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-09T04:38:31.266 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-06-09T04:38:31.267 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-09T04:38:31.267 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:31.267 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-06-09T04:38:31.267 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-06-09T04:38:31.267 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-06-09T04:38:31.268 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-06-09T04:38:31.268 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:31.268 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-06-09T04:38:31.268 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:31.269 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:31.269 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:31.269 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-06-09T04:38:31.269 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-06-09T04:38:31.270 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-06-09T04:38:31.270 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:31.270 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:31.270 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-06-09T04:38:31.270 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-06-09T04:38:31.388 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.139557.asok 2023-06-09T04:38:31.570 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.139557.asok 2023-06-09T04:38:31.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:31.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.139557.asok status 2023-06-09T04:38:31.733 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-06-09T04:38:31.733 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-06-09T04:38:31.733 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:31.733 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:31.733 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-06-09T04:38:31.733 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "139557", 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4665, 2023-06-09T04:38:31.734 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4665 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:31.735 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 637634242 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 637634242 2023-06-09T04:38:31.736 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4665 192.168.0.1:0/637634242", 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/637634242", 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 8, 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 21, 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-06-09T04:38:31.737 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2023-06-09T04:38:31.738 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-06-09T04:38:31.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.867+0000 7f5d3ce33700 1 Processor -- start 2023-06-09T04:38:31.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.867+0000 7f5d3ce33700 1 -- start start 2023-06-09T04:38:31.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3ce33700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5d3815a340 0x7f5d380b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3ce33700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d380ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3ce33700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d380b0140 0x7f5d380b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3ce33700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3815a710 con 0x7f5d380b0140 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3ce33700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380b0b00 con 0x7f5d3815a340 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3ce33700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380cee40 con 0x7f5d380ce4b0 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d380b0140 0x7f5d380b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d380b0140 0x7f5d380b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38434/0 (socket says 172.21.15.26:38434) 2023-06-09T04:38:31.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 -- 172.21.15.26:0/502830004 learned_addr learned my addr 172.21.15.26:0/502830004 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3659c700 1 --2- 172.21.15.26:0/502830004 >> v2:172.21.15.104:3300/0 conn(0x7f5d3815a340 0x7f5d380b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d35d9b700 1 --2- 172.21.15.26:0/502830004 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d380ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 -- 172.21.15.26:0/502830004 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 msgr2=0x7f5d380ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 --2- 172.21.15.26:0/502830004 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d380ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 -- 172.21.15.26:0/502830004 >> v2:172.21.15.104:3300/0 conn(0x7f5d3815a340 msgr2=0x7f5d380b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 --2- 172.21.15.26:0/502830004 >> v2:172.21.15.104:3300/0 conn(0x7f5d3815a340 0x7f5d380b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 -- 172.21.15.26:0/502830004 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380d08b0 con 0x7f5d380b0140 2023-06-09T04:38:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d36d9d700 1 --2- 172.21.15.26:0/502830004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d380b0140 0x7f5d380b05c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d38071ff0 tx=0x7f5d3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f438fffa437afa8f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3559a700 1 -- 172.21.15.26:0/502830004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000e070 con 0x7f5d380b0140 2023-06-09T04:38:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3559a700 1 -- 172.21.15.26:0/502830004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000b980 con 0x7f5d380b0140 2023-06-09T04:38:31.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.868+0000 7f5d3559a700 1 -- 172.21.15.26:0/502830004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000bd30 con 0x7f5d380b0140 2023-06-09T04:38:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 -- 172.21.15.26:0/502830004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d380b0140 msgr2=0x7f5d380b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/502830004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d380b0140 0x7f5d380b05c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d38071ff0 tx=0x7f5d3000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 -- 172.21.15.26:0/502830004 shutdown_connections 2023-06-09T04:38:31.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/502830004 >> v2:172.21.15.104:3300/0 conn(0x7f5d3815a340 0x7f5d380b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/502830004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d380b0140 0x7f5d380b05c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/502830004 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d380ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 -- 172.21.15.26:0/502830004 >> 172.21.15.26:0/502830004 conn(0x7f5d38089fc0 msgr2=0x7f5d3808a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 -- 172.21.15.26:0/502830004 shutdown_connections 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.869+0000 7f5d3ce33700 1 -- 172.21.15.26:0/502830004 wait complete. 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.870+0000 7f5d3ce33700 1 Processor -- start 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.870+0000 7f5d3ce33700 1 -- start start 2023-06-09T04:38:31.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3ce33700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d380b0140 0x7f5d3814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3ce33700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d3814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3ce33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 0x7f5d381508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3ce33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380b64f0 con 0x7f5d3815a340 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3ce33700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3814ee50 con 0x7f5d380b0140 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3ce33700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38150350 con 0x7f5d380ce4b0 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d36d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 0x7f5d381508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d36d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 0x7f5d381508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38440/0 (socket says 172.21.15.26:38440) 2023-06-09T04:38:31.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d36d9d700 1 -- 172.21.15.26:0/1439971976 learned_addr learned my addr 172.21.15.26:0/1439971976 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d3659c700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d380b0140 0x7f5d3814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.871+0000 7f5d35d9b700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d3814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d36d9d700 1 -- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 msgr2=0x7f5d3814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d36d9d700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d3814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d36d9d700 1 -- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d380b0140 msgr2=0x7f5d3814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d36d9d700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d380b0140 0x7f5d3814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:31.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d36d9d700 1 -- 172.21.15.26:0/1439971976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009b30 con 0x7f5d3815a340 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d36d9d700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 0x7f5d381508c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5d3806de40 tx=0x7f5d30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300092e0 con 0x7f5d3815a340 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30004250 con 0x7f5d3815a340 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3809b790 con 0x7f5d3815a340 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30004620 con 0x7f5d3815a340 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.872+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3809bd50 con 0x7f5d3815a340 2023-06-09T04:38:31.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.873+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38159b40 con 0x7f5d3815a340 2023-06-09T04:38:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.873+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d30004780 con 0x7f5d3815a340 2023-06-09T04:38:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.874+0000 7f5d26ffd700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5d1806ace0 0x7f5d1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:31.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.874+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d3008a9e0 con 0x7f5d3815a340 2023-06-09T04:38:31.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.874+0000 7f5d3659c700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5d1806ace0 0x7f5d1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:31.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.875+0000 7f5d3659c700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5d1806ace0 0x7f5d1806d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d28006fd0 tx=0x7f5d28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:31.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:31.878+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d300595c0 con 0x7f5d3815a340 2023-06-09T04:38:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.123+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5d3806ced0 con 0x7f5d3815a340 2023-06-09T04:38:32.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.123+0000 7f5d26ffd700 1 -- 172.21.15.26:0/1439971976 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5d30020070 con 0x7f5d3815a340 2023-06-09T04:38:32.123 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:38:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5d1806ace0 msgr2=0x7f5d1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5d1806ace0 0x7f5d1806d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d28006fd0 tx=0x7f5d28008040 comp rx=0 tx=0).stop 2023-06-09T04:38:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 msgr2=0x7f5d381508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 0x7f5d381508c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5d3806de40 tx=0x7f5d30004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 shutdown_connections 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5d1806ace0 0x7f5d1806d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3815a340 0x7f5d381508c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d380b0140 0x7f5d3814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 --2- 172.21.15.26:0/1439971976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d380ce4b0 0x7f5d3814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 >> 172.21.15.26:0/1439971976 conn(0x7f5d38089fc0 msgr2=0x7f5d380cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:32.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 shutdown_connections 2023-06-09T04:38:32.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:32.125+0000 7f5d3ce33700 1 -- 172.21.15.26:0/1439971976 wait complete. 2023-06-09T04:38:32.137 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:32.137 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:32.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-06-09T04:38:32.138 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-09T04:38:32.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:32.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:32.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:32.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:32.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:38:32.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.139 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-06-09T04:38:32.156 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:32.156 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:32.156 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:32.156 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:32.157 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42115sec preferred_lft 42115sec 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:32.158 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether b2:98:7b:f0:ed:ab brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::cc7d:7ff:fefe:5d82/64 scope link 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether b2:98:7b:f0:ed:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:38:32.159 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::b098:7bff:fef0:edab/64 scope link tentative 2023-06-09T04:38:32.160 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.160 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:32.221 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-06-09T04:38:32.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.223 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-06-09T04:38:32.281 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-06-09T04:38:32.281 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:32.281 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-09T04:38:32.281 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-09T04:38:32.281 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:32.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.282 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:32.282 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:32.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:38:32.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:38:32.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:38:32.283 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:32.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.387 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-06-09T04:38:32.403 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:38:32.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.404 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-06-09T04:38:32.460 INFO:teuthology.orchestra.run.smithi026.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-09T04:38:32.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.461 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:32.461 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:32.461 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:38:32.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-09T04:38:32.462 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:32.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:38:32.598 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:32.599 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:32.599 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:32.599 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.599 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:32.599 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.599 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:32.600 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 92:5a:03:21:91:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:32.600 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:32.600 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.600 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::905a:3ff:fe21:9123/64 scope link 2023-06-09T04:38:32.600 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:38:32.654 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:32.654 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:32.654 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:32.654 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 92:5a:03:21:91:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.655 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::905a:3ff:fe21:9123/64 scope link 2023-06-09T04:38:32.656 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:32.666 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-09T04:38:32.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.667 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:32.667 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:32.667 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-09T04:38:32.667 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:32.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-09T04:38:32.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-09T04:38:32.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-09T04:38:32.668 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:32.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:32.924 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:38:32.924 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:38:32.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.1 up 2023-06-09T04:38:32.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:38:32.925 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:38:33.042 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-06-09T04:38:33.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:33.042 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:33.064 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:38:33.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:33.064 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:33.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-06-09T04:38:33.188 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:33.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:33.255 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:33.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:33.256 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-06-09T04:38:33.312 INFO:teuthology.orchestra.run.smithi026.stdout:47 2023-06-09T04:38:33.312 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-06-09T04:38:33.313 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-06-09T04:38:33.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-06-09T04:38:33.381 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:33.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:33.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi026.stderr:2023-06-09T04:38:33.444+0000 7f7ad1b495c0 -1 init, newargv = 0x559922120a90 newargc=15 2023-06-09T04:38:33.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi026.stderr:ceph-fuse[140190]: starting ceph client 2023-06-09T04:38:33.449 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi026.stderr:ceph-fuse[140190]: starting fuse 2023-06-09T04:38:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:33.452 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:33.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:33.453 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-06-09T04:38:33.509 INFO:teuthology.orchestra.run.smithi026.stdout:47 2023-06-09T04:38:33.510 INFO:teuthology.orchestra.run.smithi026.stdout:48 2023-06-09T04:38:33.510 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-06-09T04:38:33.510 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:33.510 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-06-09T04:38:33.511 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-06-09T04:38:33.511 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-06-09T04:38:33.511 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-06-09T04:38:33.511 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:33.512 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-06-09T04:38:33.512 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-06-09T04:38:33.512 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-06-09T04:38:33.512 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-06-09T04:38:33.512 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:33.513 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-06-09T04:38:33.513 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-06-09T04:38:33.513 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-06-09T04:38:33.513 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-06-09T04:38:33.514 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:33.514 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-06-09T04:38:33.514 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:33.514 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:33.514 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:33.515 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-06-09T04:38:33.515 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-06-09T04:38:33.515 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-06-09T04:38:33.515 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:33.516 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:38:33.516 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.2")) 2023-06-09T04:38:33.516 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-06-09T04:38:33.635 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.2.140190.asok 2023-06-09T04:38:33.816 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.140190.asok 2023-06-09T04:38:33.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:33.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.140190.asok status 2023-06-09T04:38:33.978 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "2", 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-06-09T04:38:33.979 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "140190", 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4680, 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-06-09T04:38:33.980 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4680 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3581931992 2023-06-09T04:38:33.981 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3581931992 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4680 192.168.0.2:0/3581931992", 2023-06-09T04:38:33.982 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.2:0/3581931992", 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 8, 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 21, 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2023-06-09T04:38:33.983 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-06-09T04:38:33.988 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:34.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.114+0000 7f09f0ca1700 1 Processor -- start 2023-06-09T04:38:34.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.114+0000 7f09f0ca1700 1 -- start start 2023-06-09T04:38:34.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09f0ca1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09ec0aed90 0x7f09ec0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09f0ca1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09f0ca1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09ec0ceae0 0x7f09ec0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09f0ca1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec0cda30 con 0x7f09ec0aed90 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09f0ca1700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec0ca7e0 con 0x7f09ec0ceae0 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09f0ca1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec159880 con 0x7f09ec0ca370 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09ec0aed90 0x7f09ec0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09ec0aed90 0x7f09ec0c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38458/0 (socket says 172.21.15.26:38458) 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 -- 172.21.15.26:0/3814253595 learned_addr learned my addr 172.21.15.26:0/3814253595 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ead9d700 1 --2- 172.21.15.26:0/3814253595 >> v2:172.21.15.104:3300/0 conn(0x7f09ec0ceae0 0x7f09ec0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09e9d9b700 1 --2- 172.21.15.26:0/3814253595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 -- 172.21.15.26:0/3814253595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 msgr2=0x7f09ec0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 --2- 172.21.15.26:0/3814253595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 -- 172.21.15.26:0/3814253595 >> v2:172.21.15.104:3300/0 conn(0x7f09ec0ceae0 msgr2=0x7f09ec0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 --2- 172.21.15.26:0/3814253595 >> v2:172.21.15.104:3300/0 conn(0x7f09ec0ceae0 0x7f09ec0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 -- 172.21.15.26:0/3814253595 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec06cff0 con 0x7f09ec0aed90 2023-06-09T04:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ead9d700 1 --2- 172.21.15.26:0/3814253595 >> v2:172.21.15.104:3300/0 conn(0x7f09ec0ceae0 0x7f09ec0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09ea59c700 1 --2- 172.21.15.26:0/3814253595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0aed90 0x7f09ec0c9e30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0cd2a0 tx=0x7f09dc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325943a83b6d7f27 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.115+0000 7f09e959a700 1 -- 172.21.15.26:0/3814253595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc005e30 con 0x7f09ec0aed90 2023-06-09T04:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09e959a700 1 -- 172.21.15.26:0/3814253595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc004030 con 0x7f09ec0aed90 2023-06-09T04:38:34.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09e959a700 1 -- 172.21.15.26:0/3814253595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0043e0 con 0x7f09ec0aed90 2023-06-09T04:38:34.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 -- 172.21.15.26:0/3814253595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0aed90 msgr2=0x7f09ec0c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/3814253595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0aed90 0x7f09ec0c9e30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0cd2a0 tx=0x7f09dc00be70 comp rx=0 tx=0).stop 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 -- 172.21.15.26:0/3814253595 shutdown_connections 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/3814253595 >> v2:172.21.15.104:3300/0 conn(0x7f09ec0ceae0 0x7f09ec0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/3814253595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0aed90 0x7f09ec0c9e30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/3814253595 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 -- 172.21.15.26:0/3814253595 >> 172.21.15.26:0/3814253595 conn(0x7f09ec098a30 msgr2=0x7f09ec0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 -- 172.21.15.26:0/3814253595 shutdown_connections 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.116+0000 7f09f0ca1700 1 -- 172.21.15.26:0/3814253595 wait complete. 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 Processor -- start 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 -- start start 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09ec0aed90 0x7f09ec0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 0x7f09ec154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0b3e70 con 0x7f09ec0ceae0 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec155210 con 0x7f09ec0aed90 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09f0ca1700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec1e24a0 con 0x7f09ec0ca370 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09ead9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 0x7f09ec154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09ead9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 0x7f09ec154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38468/0 (socket says 172.21.15.26:38468) 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.118+0000 7f09ead9d700 1 -- 172.21.15.26:0/680157059 learned_addr learned my addr 172.21.15.26:0/680157059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ea59c700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09ec0aed90 0x7f09ec0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09e9d9b700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ead9d700 1 -- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 msgr2=0x7f09ec0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ead9d700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ead9d700 1 -- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09ec0aed90 msgr2=0x7f09ec0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ead9d700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09ec0aed90 0x7f09ec0b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ead9d700 1 -- 172.21.15.26:0/680157059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc00b7a0 con 0x7f09ec0ceae0 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ea59c700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09ec0aed90 0x7f09ec0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09ead9d700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 0x7f09ec154cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09e4007ef0 tx=0x7f09e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e400de60 con 0x7f09ec0ceae0 2023-06-09T04:38:34.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e400f040 con 0x7f09ec0ceae0 2023-06-09T04:38:34.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec0afc30 con 0x7f09ec0ceae0 2023-06-09T04:38:34.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4003c60 con 0x7f09ec0ceae0 2023-06-09T04:38:34.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.119+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec0b01f0 con 0x7f09ec0ceae0 2023-06-09T04:38:34.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.120+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec067180 con 0x7f09ec0ceae0 2023-06-09T04:38:34.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.121+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09e4004030 con 0x7f09ec0ceae0 2023-06-09T04:38:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.121+0000 7f09daffd700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f09cc06ace0 0x7f09cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.121+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09e4089680 con 0x7f09ec0ceae0 2023-06-09T04:38:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.121+0000 7f09ea59c700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f09cc06ace0 0x7f09cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.122+0000 7f09ea59c700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f09cc06ace0 0x7f09cc06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00beb0 tx=0x7f09dc012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.126+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09e4054730 con 0x7f09ec0ceae0 2023-06-09T04:38:34.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.366+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f09ec06e640 con 0x7f09ec0ceae0 2023-06-09T04:38:34.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.367+0000 7f09daffd700 1 -- 172.21.15.26:0/680157059 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f09e4057d50 con 0x7f09ec0ceae0 2023-06-09T04:38:34.367 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:38:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f09cc06ace0 msgr2=0x7f09cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f09cc06ace0 0x7f09cc06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00beb0 tx=0x7f09dc012000 comp rx=0 tx=0).stop 2023-06-09T04:38:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 msgr2=0x7f09ec154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 0x7f09ec154cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09e4007ef0 tx=0x7f09e400d3b0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 shutdown_connections 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f09cc06ace0 0x7f09cc06d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09ec0ceae0 0x7f09ec154cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09ec0aed90 0x7f09ec0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 --2- 172.21.15.26:0/680157059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09ec0ca370 0x7f09ec0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 >> 172.21.15.26:0/680157059 conn(0x7f09ec098a30 msgr2=0x7f09ec06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 shutdown_connections 2023-06-09T04:38:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:34.369+0000 7f09f0ca1700 1 -- 172.21.15.26:0/680157059 wait complete. 2023-06-09T04:38:34.381 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:34.381 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:34.381 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2023-06-09T04:38:34.381 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-09T04:38:34.381 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:34.382 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:34.382 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:34.382 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:34.382 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:38:34.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.383 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2023-06-09T04:38:34.403 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:34.403 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:34.403 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:34.404 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42180sec preferred_lft 42180sec 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::cecd:2c8:4723:d398/64 scope link noprefixroute 2023-06-09T04:38:34.405 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:34.406 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:38:34.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.406 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:34.406 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:34.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:38:34.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2023-06-09T04:38:34.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2023-06-09T04:38:34.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:38:34.408 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:34.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.578 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:34.605 INFO:teuthology.orchestra.run.smithi104.stdout:1 2023-06-09T04:38:34.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.606 DEBUG:teuthology.orchestra.run.smithi104:> route 2023-06-09T04:38:34.684 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2023-06-09T04:38:34.684 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:34.684 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:38:34.684 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:38:34.684 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:34.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.685 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:34.685 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:34.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:38:34.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:38:34.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:38:34.686 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:34.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.960 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2023-06-09T04:38:34.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:34.977 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2023-06-09T04:38:35.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:35.032 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:35.032 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:35.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:38:35.033 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-09T04:38:35.033 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:35.125 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-09T04:38:35.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:35.126 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:35.126 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:35.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-09T04:38:35.127 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:35.127 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-09T04:38:35.127 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-09T04:38:35.127 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-09T04:38:35.127 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:35.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:35.333 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:35.333 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:35.333 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2023-06-09T04:38:35.334 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:38:35.334 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:35.436 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-09T04:38:35.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:35.437 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:35.455 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:38:35.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:35.456 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:35.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2023-06-09T04:38:35.576 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:35.576 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:35.642 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:35.642 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:35.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:35.643 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2023-06-09T04:38:35.699 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:38:35.699 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-09T04:38:35.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2023-06-09T04:38:35.766 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:35.766 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:35.831 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:35.832 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:35.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:35.833 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2023-06-09T04:38:35.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi104.stderr:2023-06-09T04:38:35.838+0000 7fd30c7d15c0 -1 init, newargv = 0x55bce2d13a80 newargc=15 2023-06-09T04:38:35.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi104.stderr:ceph-fuse[137026]: starting ceph client 2023-06-09T04:38:35.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi104.stderr:ceph-fuse[137026]: starting fuse 2023-06-09T04:38:35.855 INFO:teuthology.orchestra.run.smithi104.stdout:46 2023-06-09T04:38:35.856 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-06-09T04:38:35.856 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:35.856 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2023-06-09T04:38:35.857 DEBUG:teuthology.orchestra.run.smithi104:> import re 2023-06-09T04:38:35.857 DEBUG:teuthology.orchestra.run.smithi104:> import os 2023-06-09T04:38:35.857 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2023-06-09T04:38:35.857 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:35.857 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2023-06-09T04:38:35.858 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-09T04:38:35.858 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2023-06-09T04:38:35.858 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-09T04:38:35.858 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:35.859 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2023-06-09T04:38:35.859 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2023-06-09T04:38:35.859 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2023-06-09T04:38:35.859 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2023-06-09T04:38:35.859 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:35.860 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2023-06-09T04:38:35.860 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:35.860 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:35.860 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:35.861 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2023-06-09T04:38:35.861 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2023-06-09T04:38:35.861 DEBUG:teuthology.orchestra.run.smithi104:> return f 2023-06-09T04:38:35.861 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:35.861 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:35.862 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.1")) 2023-06-09T04:38:35.862 DEBUG:teuthology.orchestra.run.smithi104:> ' 2023-06-09T04:38:35.977 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.1.137026.asok 2023-06-09T04:38:36.160 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.137026.asok 2023-06-09T04:38:36.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:36.161 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.137026.asok status 2023-06-09T04:38:36.316 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "1", 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-09T04:38:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "137026", 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4660, 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2023-06-09T04:38:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4660 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 2602024314 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: } 2023-06-09T04:38:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 2602024314 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4660 192.168.0.1:0/2602024314", 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/2602024314", 2023-06-09T04:38:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2023-06-09T04:38:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 8, 2023-06-09T04:38:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 21, 2023-06-09T04:38:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2023-06-09T04:38:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2023-06-09T04:38:36.321 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-06-09T04:38:36.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.465+0000 7f40acef2700 1 Processor -- start 2023-06-09T04:38:36.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.465+0000 7f40acef2700 1 -- start start 2023-06-09T04:38:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40acef2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a80aed50 0x7f40a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40acef2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f40a806e990 0x7f40a806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40acef2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a806f190 con 0x7f40a815c6e0 2023-06-09T04:38:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40acef2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a806e440 con 0x7f40a80aed50 2023-06-09T04:38:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40acef2700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a806e690 con 0x7f40a806e990 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a80aed50 0x7f40a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a5d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f40a80aed50 0x7f40a8069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38482/0 (socket says 172.21.15.26:38482) 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f40a815c6e0 0x7f40a80ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47338/0 (socket says 172.21.15.26:47338) 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a5d9b700 1 -- 172.21.15.26:0/578841513 learned_addr learned my addr 172.21.15.26:0/578841513 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a6d9d700 1 --2- 172.21.15.26:0/578841513 >> v2:172.21.15.104:3300/0 conn(0x7f40a806e990 0x7f40a806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a5d9b700 1 -- 172.21.15.26:0/578841513 >> v2:172.21.15.104:3300/0 conn(0x7f40a806e990 msgr2=0x7f40a806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a5d9b700 1 --2- 172.21.15.26:0/578841513 >> v2:172.21.15.104:3300/0 conn(0x7f40a806e990 0x7f40a806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.466+0000 7f40a5d9b700 1 -- 172.21.15.26:0/578841513 >> v1:172.21.15.26:6789/0 conn(0x7f40a815c6e0 legacy=0x7f40a80ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40a5d9b700 1 -- 172.21.15.26:0/578841513 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8160300 con 0x7f40a80aed50 2023-06-09T04:38:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40a559a700 1 -- 172.21.15.26:0/578841513 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297556316 0 0) 0x7f40a806f190 con 0x7f40a815c6e0 2023-06-09T04:38:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40a5d9b700 1 --2- 172.21.15.26:0/578841513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a80aed50 0x7f40a8069db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f40a8066500 tx=0x7f4098009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804a0934f81ed5cf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40a559a700 1 -- 172.21.15.26:0/578841513 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800b870 con 0x7f40a80aed50 2023-06-09T04:38:36.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40a559a700 1 -- 172.21.15.26:0/578841513 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409800b9d0 con 0x7f40a80aed50 2023-06-09T04:38:36.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40a559a700 1 -- 172.21.15.26:0/578841513 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800bd60 con 0x7f40a80aed50 2023-06-09T04:38:36.471 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 -- 172.21.15.26:0/578841513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a80aed50 msgr2=0x7f40a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 --2- 172.21.15.26:0/578841513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a80aed50 0x7f40a8069db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f40a8066500 tx=0x7f4098009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 -- 172.21.15.26:0/578841513 shutdown_connections 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 --2- 172.21.15.26:0/578841513 >> v2:172.21.15.104:3300/0 conn(0x7f40a806e990 0x7f40a806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 --2- 172.21.15.26:0/578841513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a80aed50 0x7f40a8069db0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 -- 172.21.15.26:0/578841513 >> 172.21.15.26:0/578841513 conn(0x7f40a8098a30 msgr2=0x7f40a80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.467+0000 7f40acef2700 1 -- 172.21.15.26:0/578841513 shutdown_connections 2023-06-09T04:38:36.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.468+0000 7f40acef2700 1 -- 172.21.15.26:0/578841513 wait complete. 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.469+0000 7f40acef2700 1 Processor -- start 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.469+0000 7f40acef2700 1 -- start start 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40a806e990 0x7f40a81f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f40a80aed50 0x7f40a80c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 0x7f40a80c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81f5b60 con 0x7f40a815c6e0 2023-06-09T04:38:36.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80c54f0 con 0x7f40a806e990 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80c5740 con 0x7f40a80aed50 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 0x7f40a80c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 0x7f40a80c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38490/0 (socket says 172.21.15.26:38490) 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 -- 172.21.15.26:0/2522477669 learned_addr learned my addr 172.21.15.26:0/2522477669 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a659c700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40a806e990 0x7f40a81f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a5d9b700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f40a80aed50 0x7f40a80c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 -- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f40a80aed50 msgr2=0x7f40a80c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f40a80aed50 0x7f40a80c4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 -- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40a806e990 msgr2=0x7f40a81f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40a806e990 0x7f40a81f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 -- 172.21.15.26:0/2522477669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098009550 con 0x7f40a815c6e0 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a659c700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40a806e990 0x7f40a81f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40a6d9d700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 0x7f40a80c4fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f40a0007d80 tx=0x7f40a000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000ede0 con 0x7f40a815c6e0 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a0014420 con 0x7f40a815c6e0 2023-06-09T04:38:36.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.470+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a81f5510 con 0x7f40a815c6e0 2023-06-09T04:38:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.471+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00147d0 con 0x7f40a815c6e0 2023-06-09T04:38:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.471+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a80c5a20 con 0x7f40a815c6e0 2023-06-09T04:38:36.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.471+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a81f5d10 con 0x7f40a815c6e0 2023-06-09T04:38:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.472+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40a0014930 con 0x7f40a815c6e0 2023-06-09T04:38:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.472+0000 7f4096ffd700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f408806ace0 0x7f408806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.472+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40a0089be0 con 0x7f40a815c6e0 2023-06-09T04:38:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.473+0000 7f40a659c700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f408806ace0 0x7f408806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.473+0000 7f40a659c700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f408806ace0 0x7f408806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f409c001020 tx=0x7f409c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.477+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40a81f5d10 con 0x7f40a815c6e0 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.722+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40a81f5d10 con 0x7f40a815c6e0 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.722+0000 7f4096ffd700 1 -- 172.21.15.26:0/2522477669 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40a81f5d10 con 0x7f40a815c6e0 2023-06-09T04:38:36.723 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:38:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f408806ace0 msgr2=0x7f408806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f408806ace0 0x7f408806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f409c001020 tx=0x7f409c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 msgr2=0x7f40a80c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 0x7f40a80c4fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f40a0007d80 tx=0x7f40a000e3c0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 shutdown_connections 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f408806ace0 0x7f408806d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40a815c6e0 0x7f40a80c4fb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40a806e990 0x7f40a81f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 --2- 172.21.15.26:0/2522477669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f40a80aed50 0x7f40a80c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 >> 172.21.15.26:0/2522477669 conn(0x7f40a8098a30 msgr2=0x7f40a80cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 shutdown_connections 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:36.724+0000 7f40acef2700 1 -- 172.21.15.26:0/2522477669 wait complete. 2023-06-09T04:38:36.736 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:36.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:36.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2023-06-09T04:38:36.737 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-09T04:38:36.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:36.737 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:36.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:36.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:36.738 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:38:36.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:36.738 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42178sec preferred_lft 42178sec 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::cecd:2c8:4723:d398/64 scope link noprefixroute 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 52:75:87:87:50:fc brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::68b3:47ff:fefd:8e27/64 scope link 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 52:75:87:87:50:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::5075:87ff:fe87:50fc/64 scope link tentative 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:36.759 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:36.820 INFO:teuthology.orchestra.run.smithi104.stdout:1 2023-06-09T04:38:36.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:36.822 DEBUG:teuthology.orchestra.run.smithi104:> route 2023-06-09T04:38:36.879 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2023-06-09T04:38:36.880 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:36.880 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:38:36.880 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:38:36.880 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:36.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:36.881 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:36.881 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:36.881 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:38:36.881 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:38:36.882 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:38:36.882 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:36.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:36.984 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2023-06-09T04:38:37.000 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T04:38:37.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.001 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2023-06-09T04:38:37.056 INFO:teuthology.orchestra.run.smithi104.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-09T04:38:37.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.056 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:37.057 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:37.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T04:38:37.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-09T04:38:37.057 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:37.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.149 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:38:37.186 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:37.186 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:37.186 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether fa:2b:1e:e5:8b:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.187 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::f82b:1eff:fee5:8bd5/64 scope link 2023-06-09T04:38:37.188 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:38:37.278 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:37.278 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:37.278 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:37.278 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.278 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether fa:2b:1e:e5:8b:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::f82b:1eff:fee5:8bd5/64 scope link 2023-06-09T04:38:37.279 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:37.288 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-09T04:38:37.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.289 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:37.289 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:37.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-09T04:38:37.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:37.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-09T04:38:37.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-09T04:38:37.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-09T04:38:37.290 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:37.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.529 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2023-06-09T04:38:37.529 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2023-06-09T04:38:37.530 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.1 up 2023-06-09T04:38:37.530 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:38:37.530 DEBUG:teuthology.orchestra.run.smithi104:> ') 2023-06-09T04:38:37.653 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-06-09T04:38:37.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:37.654 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:38:37.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:37.674 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:37.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2023-06-09T04:38:37.797 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:37.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:37.862 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:37.863 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:37.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:37.864 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2023-06-09T04:38:37.921 INFO:teuthology.orchestra.run.smithi104.stdout:46 2023-06-09T04:38:37.921 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-06-09T04:38:37.922 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-06-09T04:38:37.963 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2023-06-09T04:38:37.989 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:37.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:38.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi104.stderr:2023-06-09T04:38:38.047+0000 7f7b43a715c0 -1 init, newargv = 0x55e212a7e070 newargc=15 2023-06-09T04:38:38.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi104.stderr:ceph-fuse[137616]: starting ceph client 2023-06-09T04:38:38.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi104.stderr:ceph-fuse[137616]: starting fuse 2023-06-09T04:38:38.059 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:38.059 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:38.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.060 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2023-06-09T04:38:38.116 INFO:teuthology.orchestra.run.smithi104.stdout:46 2023-06-09T04:38:38.117 INFO:teuthology.orchestra.run.smithi104.stdout:48 2023-06-09T04:38:38.117 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-06-09T04:38:38.117 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:38.117 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2023-06-09T04:38:38.118 DEBUG:teuthology.orchestra.run.smithi104:> import re 2023-06-09T04:38:38.118 DEBUG:teuthology.orchestra.run.smithi104:> import os 2023-06-09T04:38:38.118 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2023-06-09T04:38:38.118 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:38.118 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2023-06-09T04:38:38.119 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-06-09T04:38:38.119 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2023-06-09T04:38:38.119 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-06-09T04:38:38.119 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:38.120 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2023-06-09T04:38:38.120 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2023-06-09T04:38:38.120 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2023-06-09T04:38:38.120 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2023-06-09T04:38:38.120 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:38.121 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2023-06-09T04:38:38.121 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:38.121 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:38.121 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:38.122 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2023-06-09T04:38:38.122 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2023-06-09T04:38:38.122 DEBUG:teuthology.orchestra.run.smithi104:> return f 2023-06-09T04:38:38.122 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:38.122 DEBUG:teuthology.orchestra.run.smithi104:> 2023-06-09T04:38:38.123 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.3")) 2023-06-09T04:38:38.123 DEBUG:teuthology.orchestra.run.smithi104:> ' 2023-06-09T04:38:38.238 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.3.137616.asok 2023-06-09T04:38:38.420 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.137616.asok 2023-06-09T04:38:38.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.137616.asok status 2023-06-09T04:38:38.575 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2023-06-09T04:38:38.576 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2023-06-09T04:38:38.576 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:38.576 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:38.576 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "3", 2023-06-09T04:38:38.576 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2023-06-09T04:38:38.576 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "137616", 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4672, 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2023-06-09T04:38:38.577 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4672 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 2237518347 2023-06-09T04:38:38.578 INFO:teuthology.orchestra.run.smithi104.stdout: } 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 2237518347 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4672 192.168.0.2:0/2237518347", 2023-06-09T04:38:38.579 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.2:0/2237518347", 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 8, 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 21, 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2023-06-09T04:38:38.580 INFO:teuthology.orchestra.run.smithi104.stdout:} 2023-06-09T04:38:38.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.586 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-06-09T04:38:38.586 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:38.607 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-06-09T04:38:38.608 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:38.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:38.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.683 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-06-09T04:38:38.683 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:38.743 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-06-09T04:38:38.743 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:38.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:38.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.820 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2023-06-09T04:38:38.821 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:38.838 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2023-06-09T04:38:38.838 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:38.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:38.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.905 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2023-06-09T04:38:38.905 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:38.962 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2023-06-09T04:38:38.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:38.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:38.962 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:39.028 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-09T04:38:39.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:39.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 Processor -- start 2023-06-09T04:38:39.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 -- start start 2023-06-09T04:38:39.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23f80b07c0 0x7f23f80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23f80caf70 0x7f23f80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80b00a0 con 0x7f23f80b07c0 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80cfc20 con 0x7f23f80caf70 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.184+0000 7f23fdeaa700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80cc0f0 con 0x7f23f815d780 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23f80b07c0 0x7f23f80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23f80b07c0 0x7f23f80cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38496/0 (socket says 172.21.15.26:38496) 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 -- 172.21.15.26:0/982871648 learned_addr learned my addr 172.21.15.26:0/982871648 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f7fff700 1 --2- 172.21.15.26:0/982871648 >> v2:172.21.15.104:3300/0 conn(0x7f23f80caf70 0x7f23f80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f77fe700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 -- 172.21.15.26:0/982871648 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 msgr2=0x7f23f80b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f80b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 -- 172.21.15.26:0/982871648 >> v2:172.21.15.104:3300/0 conn(0x7f23f80caf70 msgr2=0x7f23f80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 --2- 172.21.15.26:0/982871648 >> v2:172.21.15.104:3300/0 conn(0x7f23f80caf70 0x7f23f80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 -- 172.21.15.26:0/982871648 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80cb4e0 con 0x7f23f80b07c0 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f7fff700 1 --2- 172.21.15.26:0/982871648 >> v2:172.21.15.104:3300/0 conn(0x7f23f80caf70 0x7f23f80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f77fe700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f80b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:39.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f6ffd700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80b07c0 0x7f23f80cc580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23f806de20 tx=0x7f23ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a42096922031f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f67fc700 1 -- 172.21.15.26:0/982871648 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00b870 con 0x7f23f80b07c0 2023-06-09T04:38:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f67fc700 1 -- 172.21.15.26:0/982871648 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec00b9d0 con 0x7f23f80b07c0 2023-06-09T04:38:39.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.185+0000 7f23f67fc700 1 -- 172.21.15.26:0/982871648 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00bd60 con 0x7f23f80b07c0 2023-06-09T04:38:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 -- 172.21.15.26:0/982871648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80b07c0 msgr2=0x7f23f80cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80b07c0 0x7f23f80cc580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23f806de20 tx=0x7f23ec009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 -- 172.21.15.26:0/982871648 shutdown_connections 2023-06-09T04:38:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/982871648 >> v2:172.21.15.104:3300/0 conn(0x7f23f80caf70 0x7f23f80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f80b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/982871648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80b07c0 0x7f23f80cc580 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 -- 172.21.15.26:0/982871648 >> 172.21.15.26:0/982871648 conn(0x7f23f8089fc0 msgr2=0x7f23f80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 -- 172.21.15.26:0/982871648 shutdown_connections 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.186+0000 7f23fdeaa700 1 -- 172.21.15.26:0/982871648 wait complete. 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.187+0000 7f23fdeaa700 1 Processor -- start 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.188+0000 7f23fdeaa700 1 -- start start 2023-06-09T04:38:39.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23fdeaa700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23f80b07c0 0x7f23f81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23fdeaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 0x7f23f806e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23fdeaa700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f806eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23fdeaa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f806c750 con 0x7f23f80caf70 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23fdeaa700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80ae880 con 0x7f23f80b07c0 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23fdeaa700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f806bad0 con 0x7f23f815d780 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 0x7f23f806e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 0x7f23f806e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38502/0 (socket says 172.21.15.26:38502) 2023-06-09T04:38:39.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 -- 172.21.15.26:0/4234558218 learned_addr learned my addr 172.21.15.26:0/4234558218 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f77fe700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23f80b07c0 0x7f23f81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f7fff700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f806eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 -- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 msgr2=0x7f23f806eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f806eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 -- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23f80b07c0 msgr2=0x7f23f81579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23f80b07c0 0x7f23f81579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 -- 172.21.15.26:0/4234558218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec009550 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23f6ffd700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 0x7f23f806e5e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000c00 tx=0x7f23ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.189+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec004540 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.190+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec0036a0 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.190+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f806bdb0 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.190+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec003a50 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.190+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f806c370 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.190+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f806c890 con 0x7f23f80caf70 2023-06-09T04:38:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.191+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23ec021070 con 0x7f23f80caf70 2023-06-09T04:38:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.191+0000 7f23dffff700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23e406ace0 0x7f23e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.191+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23ec08ab00 con 0x7f23f80caf70 2023-06-09T04:38:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.192+0000 7f23f77fe700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23e406ace0 0x7f23e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.192+0000 7f23f77fe700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23e406ace0 0x7f23e406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23e800c920 tx=0x7f23e8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.196+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23f806c890 con 0x7f23f80caf70 2023-06-09T04:38:39.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.394+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23f806c890 con 0x7f23f80caf70 2023-06-09T04:38:39.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.395+0000 7f23dffff700 1 -- 172.21.15.26:0/4234558218 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f23f806c890 con 0x7f23f80caf70 2023-06-09T04:38:39.396 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:39.396 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:39.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23e406ace0 msgr2=0x7f23e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23e406ace0 0x7f23e406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23e800c920 tx=0x7f23e8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 msgr2=0x7f23f806e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 0x7f23f806e5e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000c00 tx=0x7f23ec004750 comp rx=0 tx=0).stop 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 shutdown_connections 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23f815d780 0x7f23f806eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23f80b07c0 0x7f23f81579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23e406ace0 0x7f23e406d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 --2- 172.21.15.26:0/4234558218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23f80caf70 0x7f23f806e5e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 >> 172.21.15.26:0/4234558218 conn(0x7f23f8089fc0 msgr2=0x7f23f80cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 shutdown_connections 2023-06-09T04:38:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.397+0000 7f23fdeaa700 1 -- 172.21.15.26:0/4234558218 wait complete. 2023-06-09T04:38:39.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:39.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 Processor -- start 2023-06-09T04:38:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 -- start start 2023-06-09T04:38:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc0ec15c550 0x7fc0ec160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0cc620 0x7fc0ec0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ec0cce70 con 0x7fc0ec0d0740 2023-06-09T04:38:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ec161030 con 0x7fc0ec15c550 2023-06-09T04:38:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.538+0000 7fc0f1a8b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec160790 con 0x7fc0ec0cc620 2023-06-09T04:38:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0ebfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0ec0d0740 0x7fc0ec0d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47370/0 (socket says 172.21.15.26:47370) 2023-06-09T04:38:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0ebfff700 1 -- 172.21.15.26:0/2736684887 learned_addr learned my addr 172.21.15.26:0/2736684887 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/2736684887 >> v2:172.21.15.104:3300/0 conn(0x7fc0ec15c550 0x7fc0ec160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eaffd700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0cc620 0x7fc0ec0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0ea7fc700 1 -- 172.21.15.26:0/2736684887 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357238781 0 0) 0x7fc0ec0cce70 con 0x7fc0ec0d0740 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0ea7fc700 1 -- 172.21.15.26:0/2736684887 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d40035b0 con 0x7fc0ec0d0740 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0cc620 msgr2=0x7fc0ec0caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0cc620 0x7fc0ec0caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0ea7fc700 1 -- 172.21.15.26:0/2736684887 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3118044898 0 0) 0x7fc0d40035b0 con 0x7fc0ec0d0740 2023-06-09T04:38:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/2736684887 >> v1:172.21.15.26:6789/0 conn(0x7fc0ec0d0740 legacy=0x7fc0ec0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/2736684887 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec160a70 con 0x7fc0ec15c550 2023-06-09T04:38:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eaffd700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0cc620 0x7fc0ec0caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec160100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009820 tx=0x7fc0dc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=745e986e8b5a5b0d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.539+0000 7fc0ea7fc700 1 -- 172.21.15.26:0/2736684887 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e40019f0 con 0x7fc0ec15c550 2023-06-09T04:38:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0ea7fc700 1 -- 172.21.15.26:0/2736684887 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc005c30 con 0x7fc0ec15c550 2023-06-09T04:38:39.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0ea7fc700 1 -- 172.21.15.26:0/2736684887 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc004030 con 0x7fc0ec15c550 2023-06-09T04:38:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 msgr2=0x7fc0ec160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec160100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009820 tx=0x7fc0dc009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/2736684887 shutdown_connections 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec160100 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/2736684887 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0cc620 0x7fc0ec0caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/2736684887 >> 172.21.15.26:0/2736684887 conn(0x7fc0ec089fc0 msgr2=0x7fc0ec08a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/2736684887 shutdown_connections 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.540+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/2736684887 wait complete. 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.541+0000 7fc0f1a8b700 1 Processor -- start 2023-06-09T04:38:39.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.541+0000 7fc0f1a8b700 1 -- start start 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0f1a8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 0x7fc0ec0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0f1a8b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0d0740 0x7fc0ec0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0f1a8b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0f1a8b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec0b4e70 con 0x7fc0ec0cc620 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0f1a8b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec157690 con 0x7fc0ec15c550 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0f1a8b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec0c5e20 con 0x7fc0ec0d0740 2023-06-09T04:38:39.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 0x7fc0ec0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 0x7fc0ec0c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38514/0 (socket says 172.21.15.26:38514) 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.542+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/1547582458 learned_addr learned my addr 172.21.15.26:0/1547582458 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eaffd700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0d0740 0x7fc0ec0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0ebfff700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0d0740 msgr2=0x7fc0ec0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0d0740 0x7fc0ec0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 msgr2=0x7fc0ec0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec0b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/1547582458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00094a0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eaffd700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0d0740 0x7fc0ec0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 0x7fc0ec0c5740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009770 tx=0x7fc0dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc003c30 con 0x7fc0ec0cc620 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc003d90 con 0x7fc0ec0cc620 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc009430 con 0x7fc0ec0cc620 2023-06-09T04:38:39.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc01d650 con 0x7fc0ec0cc620 2023-06-09T04:38:39.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.543+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec0c63e0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.544+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec0ccbd0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.544+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0dc01d7b0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.545+0000 7fc0d3fff700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0d806ace0 0x7fc0d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.545+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0dc08a7d0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.545+0000 7fc0eaffd700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0d806ace0 0x7fc0d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.545+0000 7fc0eaffd700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0d806ace0 0x7fc0d806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec09e7c0 tx=0x7fc0e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.549+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0dc0559b0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.748+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0ec160d20 con 0x7fc0ec0cc620 2023-06-09T04:38:39.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.748+0000 7fc0d3fff700 1 -- 172.21.15.26:0/1547582458 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0dc058fd0 con 0x7fc0ec0cc620 2023-06-09T04:38:39.767 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:39.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0d806ace0 msgr2=0x7fc0d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0d806ace0 0x7fc0d806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec09e7c0 tx=0x7fc0e0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:39.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 msgr2=0x7fc0ec0c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 0x7fc0ec0c5740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009770 tx=0x7fc0dc004750 comp rx=0 tx=0).stop 2023-06-09T04:38:39.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 shutdown_connections 2023-06-09T04:38:39.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0ec15c550 0x7fc0ec0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0d806ace0 0x7fc0d806d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0ec0cc620 0x7fc0ec0c5740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 --2- 172.21.15.26:0/1547582458 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0ec0d0740 0x7fc0ec0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 >> 172.21.15.26:0/1547582458 conn(0x7fc0ec089fc0 msgr2=0x7fc0ec0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 shutdown_connections 2023-06-09T04:38:39.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.750+0000 7fc0f1a8b700 1 -- 172.21.15.26:0/1547582458 wait complete. 2023-06-09T04:38:39.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.897+0000 7fb440cec700 1 Processor -- start 2023-06-09T04:38:39.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.897+0000 7fb440cec700 1 -- start start 2023-06-09T04:38:39.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.898+0000 7fb440cec700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0ce520 0x7fb43c15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.898+0000 7fb440cec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb43c15a5b0 0x7fb43c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.898+0000 7fb440cec700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb43c0b1240 0x7fb43c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.898+0000 7fb440cec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c15ae10 con 0x7fb43c15a5b0 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.898+0000 7fb440cec700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0cee30 con 0x7fb43c0b1240 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.898+0000 7fb440cec700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0aeff0 con 0x7fb43c0ce520 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb43c15a5b0 0x7fb43c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb43c15a5b0 0x7fb43c0ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38522/0 (socket says 172.21.15.26:38522) 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 -- 172.21.15.26:0/3722843829 learned_addr learned my addr 172.21.15.26:0/3722843829 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb43a59c700 1 --2- 172.21.15.26:0/3722843829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0ce520 0x7fb43c15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb43ad9d700 1 --2- 172.21.15.26:0/3722843829 >> v2:172.21.15.104:3300/0 conn(0x7fb43c0b1240 0x7fb43c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 -- 172.21.15.26:0/3722843829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0ce520 msgr2=0x7fb43c15b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 --2- 172.21.15.26:0/3722843829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0ce520 0x7fb43c15b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 -- 172.21.15.26:0/3722843829 >> v2:172.21.15.104:3300/0 conn(0x7fb43c0b1240 msgr2=0x7fb43c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 --2- 172.21.15.26:0/3722843829 >> v2:172.21.15.104:3300/0 conn(0x7fb43c0b1240 0x7fb43c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 -- 172.21.15.26:0/3722843829 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0b1d00 con 0x7fb43c15a5b0 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb439d9b700 1 --2- 172.21.15.26:0/3722843829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a5b0 0x7fb43c0ce8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb43c071160 tx=0x7fb430009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf06251d5ce2914 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb43959a700 1 -- 172.21.15.26:0/3722843829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000b870 con 0x7fb43c15a5b0 2023-06-09T04:38:39.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb43959a700 1 -- 172.21.15.26:0/3722843829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000b9d0 con 0x7fb43c15a5b0 2023-06-09T04:38:39.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.899+0000 7fb43959a700 1 -- 172.21.15.26:0/3722843829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000bd60 con 0x7fb43c15a5b0 2023-06-09T04:38:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 -- 172.21.15.26:0/3722843829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a5b0 msgr2=0x7fb43c0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 --2- 172.21.15.26:0/3722843829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a5b0 0x7fb43c0ce8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb43c071160 tx=0x7fb430009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 -- 172.21.15.26:0/3722843829 shutdown_connections 2023-06-09T04:38:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 --2- 172.21.15.26:0/3722843829 >> v2:172.21.15.104:3300/0 conn(0x7fb43c0b1240 0x7fb43c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 --2- 172.21.15.26:0/3722843829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0ce520 0x7fb43c15b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 --2- 172.21.15.26:0/3722843829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a5b0 0x7fb43c0ce8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 -- 172.21.15.26:0/3722843829 >> 172.21.15.26:0/3722843829 conn(0x7fb43c098b50 msgr2=0x7fb43c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 -- 172.21.15.26:0/3722843829 shutdown_connections 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.900+0000 7fb440cec700 1 -- 172.21.15.26:0/3722843829 wait complete. 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.901+0000 7fb440cec700 1 Processor -- start 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.901+0000 7fb440cec700 1 -- start start 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb440cec700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0b1240 0x7fb43c1e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb440cec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 0x7fb43c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb440cec700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb43c15a5b0 0x7fb43c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb440cec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c06e0e0 con 0x7fb43c0ce520 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb440cec700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c06e3c0 con 0x7fb43c15a5b0 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb440cec700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c06e6a0 con 0x7fb43c0b1240 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 0x7fb43c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 0x7fb43c1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38528/0 (socket says 172.21.15.26:38528) 2023-06-09T04:38:39.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 -- 172.21.15.26:0/1784847134 learned_addr learned my addr 172.21.15.26:0/1784847134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb43a59c700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0b1240 0x7fb43c1e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb43ad9d700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb43c15a5b0 0x7fb43c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 -- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0b1240 msgr2=0x7fb43c1e4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0b1240 0x7fb43c1e4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 -- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb43c15a5b0 msgr2=0x7fb43c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb43c15a5b0 0x7fb43c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 -- 172.21.15.26:0/1784847134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009550 con 0x7fb43c0ce520 2023-06-09T04:38:39.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb43ad9d700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb43c15a5b0 0x7fb43c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.902+0000 7fb439d9b700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 0x7fb43c1556f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb430000c00 tx=0x7fb430004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.903+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430004310 con 0x7fb43c0ce520 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.903+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43001f070 con 0x7fb43c0ce520 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.903+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300036a0 con 0x7fb43c0ce520 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.903+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c06e980 con 0x7fb43c0ce520 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.903+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c1e4ac0 con 0x7fb43c0ce520 2023-06-09T04:38:39.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.904+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c067180 con 0x7fb43c0ce520 2023-06-09T04:38:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.904+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb430021030 con 0x7fb43c0ce520 2023-06-09T04:38:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.904+0000 7fb42affd700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb41c06ace0 0x7fb41c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.905+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb43008a640 con 0x7fb43c0ce520 2023-06-09T04:38:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.905+0000 7fb43a59c700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb41c06ace0 0x7fb41c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.905+0000 7fb43a59c700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb41c06ace0 0x7fb41c06d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006fd0 tx=0x7fb42c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:39.909+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb430055780 con 0x7fb43c0ce520 2023-06-09T04:38:40.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.107+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb43c069fb0 con 0x7fb43c0ce520 2023-06-09T04:38:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.108+0000 7fb42affd700 1 -- 172.21.15.26:0/1784847134 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb430058da0 con 0x7fb43c0ce520 2023-06-09T04:38:40.108 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb41c06ace0 msgr2=0x7fb41c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb41c06ace0 0x7fb41c06d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006fd0 tx=0x7fb42c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 msgr2=0x7fb43c1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 0x7fb43c1556f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb430000c00 tx=0x7fb430004750 comp rx=0 tx=0).stop 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 shutdown_connections 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb43c15a5b0 0x7fb43c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb43c0b1240 0x7fb43c1e4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb41c06ace0 0x7fb41c06d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 --2- 172.21.15.26:0/1784847134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0ce520 0x7fb43c1556f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 >> 172.21.15.26:0/1784847134 conn(0x7fb43c098b50 msgr2=0x7fb43c0ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 shutdown_connections 2023-06-09T04:38:40.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.110+0000 7fb440cec700 1 -- 172.21.15.26:0/1784847134 wait complete. 2023-06-09T04:38:40.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.249+0000 7f3652304700 1 Processor -- start 2023-06-09T04:38:40.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.249+0000 7f3652304700 1 -- start start 2023-06-09T04:38:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f3652304700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f3652304700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f364c069db0 0x7f364c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f3652304700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c15e6b0 con 0x7f364c15add0 2023-06-09T04:38:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f3652304700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c06a730 con 0x7f364c069db0 2023-06-09T04:38:40.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f3652304700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15b8b0 con 0x7f364c15eb40 2023-06-09T04:38:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f364bfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f364c15add0 0x7f364c15b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47392/0 (socket says 172.21.15.26:47392) 2023-06-09T04:38:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f364bfff700 1 -- 172.21.15.26:0/2610286694 learned_addr learned my addr 172.21.15.26:0/2610286694 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f36508a1700 1 --2- 172.21.15.26:0/2610286694 >> v2:172.21.15.104:3300/0 conn(0x7f364c069db0 0x7f364c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f364b7fe700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f364affd700 1 -- 172.21.15.26:0/2610286694 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689914355 0 0) 0x7f364c15e6b0 con 0x7f364c15add0 2023-06-09T04:38:40.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.250+0000 7f364affd700 1 -- 172.21.15.26:0/2610286694 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36380035b0 con 0x7f364c15add0 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f36508a1700 1 -- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 msgr2=0x7f364c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f36508a1700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f364affd700 1 -- 172.21.15.26:0/2610286694 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288144945 0 0) 0x7f36380035b0 con 0x7f364c15add0 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f36508a1700 1 -- 172.21.15.26:0/2610286694 >> v1:172.21.15.26:6789/0 conn(0x7f364c15add0 legacy=0x7f364c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f36508a1700 1 -- 172.21.15.26:0/2610286694 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0c9460 con 0x7f364c069db0 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f364b7fe700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f36508a1700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c069db0 0x7f364c06a1f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3644009d90 tx=0x7f364400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d40644227eccb72 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f364affd700 1 -- 172.21.15.26:0/2610286694 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400e070 con 0x7f364c069db0 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f364affd700 1 -- 172.21.15.26:0/2610286694 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3644003a20 con 0x7f364c069db0 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f364affd700 1 -- 172.21.15.26:0/2610286694 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634001670 con 0x7f364c069db0 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f3652304700 1 -- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c069db0 msgr2=0x7f364c06a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f3652304700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c069db0 0x7f364c06a1f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3644009d90 tx=0x7f364400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.251+0000 7f3652304700 1 -- 172.21.15.26:0/2610286694 shutdown_connections 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.252+0000 7f3652304700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c069db0 0x7f364c06a1f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.252+0000 7f3652304700 1 --2- 172.21.15.26:0/2610286694 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.252+0000 7f3652304700 1 -- 172.21.15.26:0/2610286694 >> 172.21.15.26:0/2610286694 conn(0x7f364c0b0f10 msgr2=0x7f364c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.252+0000 7f3652304700 1 -- 172.21.15.26:0/2610286694 shutdown_connections 2023-06-09T04:38:40.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.252+0000 7f3652304700 1 -- 172.21.15.26:0/2610286694 wait complete. 2023-06-09T04:38:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.253+0000 7f3652304700 1 Processor -- start 2023-06-09T04:38:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.253+0000 7f3652304700 1 -- start start 2023-06-09T04:38:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 0x7f364c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c15add0 0x7f364c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15a760 con 0x7f364c069db0 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0ac6e0 con 0x7f364c15add0 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0ac9c0 con 0x7f364c15eb40 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 0x7f364c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 0x7f364c15a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38536/0 (socket says 172.21.15.26:38536) 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 -- 172.21.15.26:0/2377690195 learned_addr learned my addr 172.21.15.26:0/2377690195 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f36508a1700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364b7fe700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c15add0 0x7f364c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 -- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 msgr2=0x7f364c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 -- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c15add0 msgr2=0x7f364c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c15add0 0x7f364c0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 -- 172.21.15.26:0/2377690195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0094a0 con 0x7f364c069db0 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f364bfff700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 0x7f364c15a220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f363400c780 tx=0x7f363400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634004c80 con 0x7f364c069db0 2023-06-09T04:38:40.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634004de0 con 0x7f364c069db0 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3644009a70 con 0x7f364c069db0 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340072f0 con 0x7f364c069db0 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.254+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c0acf80 con 0x7f364c069db0 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.255+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c074080 con 0x7f364c069db0 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.256+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3634007450 con 0x7f364c069db0 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.256+0000 7f3648ff9700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f362c06ace0 0x7f362c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.256+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36340889f0 con 0x7f364c069db0 2023-06-09T04:38:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.257+0000 7f364b7fe700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f362c06ace0 0x7f362c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.257+0000 7f364b7fe700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f362c06ace0 0x7f362c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f364c0af2e0 tx=0x7f363c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.261+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3634053b30 con 0x7f364c069db0 2023-06-09T04:38:40.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.459+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f364c0b15d0 con 0x7f364c069db0 2023-06-09T04:38:40.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.459+0000 7f3648ff9700 1 -- 172.21.15.26:0/2377690195 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3634018020 con 0x7f364c069db0 2023-06-09T04:38:40.460 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:40.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f362c06ace0 msgr2=0x7f362c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f362c06ace0 0x7f362c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f364c0af2e0 tx=0x7f363c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 msgr2=0x7f364c15a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 0x7f364c15a220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f363400c780 tx=0x7f363400cb40 comp rx=0 tx=0).stop 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 shutdown_connections 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f364c15eb40 0x7f364c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f362c06ace0 0x7f362c06d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f364c069db0 0x7f364c15a220 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 --2- 172.21.15.26:0/2377690195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f364c15add0 0x7f364c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 >> 172.21.15.26:0/2377690195 conn(0x7f364c0b0f10 msgr2=0x7f364c0af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 shutdown_connections 2023-06-09T04:38:40.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.462+0000 7f3652304700 1 -- 172.21.15.26:0/2377690195 wait complete. 2023-06-09T04:38:40.474 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:40.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.602+0000 7f1887f25700 1 Processor -- start 2023-06-09T04:38:40.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.602+0000 7f1887f25700 1 -- start start 2023-06-09T04:38:40.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1887f25700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f188015a340 0x7f18800b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1887f25700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18800ce4b0 0x7f18800ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1887f25700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18800cee40 con 0x7f18800b0140 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1887f25700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188015a710 con 0x7f18800ce4b0 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1887f25700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800d08b0 con 0x7f188015a340 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18864c2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f18800b0140 0x7f18800ad470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47406/0 (socket says 172.21.15.26:47406) 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18854c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f18800ce4b0 0x7f18800ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18864c2700 1 -- 172.21.15.26:0/316651633 learned_addr learned my addr 172.21.15.26:0/316651633 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1885cc1700 1 --2- 172.21.15.26:0/316651633 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f188015a340 0x7f18800b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18854c0700 1 -- 172.21.15.26:0/316651633 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f188015a340 msgr2=0x7f18800b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18854c0700 1 --2- 172.21.15.26:0/316651633 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f188015a340 0x7f18800b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18854c0700 1 -- 172.21.15.26:0/316651633 >> v1:172.21.15.26:6789/0 conn(0x7f18800b0140 legacy=0x7f18800ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f1884cbf700 1 -- 172.21.15.26:0/316651633 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259557025 0 0) 0x7f1878001490 con 0x7f18800b0140 2023-06-09T04:38:40.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.603+0000 7f18854c0700 1 -- 172.21.15.26:0/316651633 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800b0d20 con 0x7f18800ce4b0 2023-06-09T04:38:40.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f18854c0700 1 --2- 172.21.15.26:0/316651633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f18800ce900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1870009840 tx=0x7f1870009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d1dabbdf97d1a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1884cbf700 1 -- 172.21.15.26:0/316651633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870011830 con 0x7f18800ce4b0 2023-06-09T04:38:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1884cbf700 1 -- 172.21.15.26:0/316651633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870011990 con 0x7f18800ce4b0 2023-06-09T04:38:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1884cbf700 1 -- 172.21.15.26:0/316651633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870011d20 con 0x7f18800ce4b0 2023-06-09T04:38:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 -- 172.21.15.26:0/316651633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 msgr2=0x7f18800ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 --2- 172.21.15.26:0/316651633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f18800ce900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1870009840 tx=0x7f1870009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 -- 172.21.15.26:0/316651633 shutdown_connections 2023-06-09T04:38:40.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 --2- 172.21.15.26:0/316651633 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f188015a340 0x7f18800b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 --2- 172.21.15.26:0/316651633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f18800ce900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 -- 172.21.15.26:0/316651633 >> 172.21.15.26:0/316651633 conn(0x7f1880089fc0 msgr2=0x7f188008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 -- 172.21.15.26:0/316651633 shutdown_connections 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.604+0000 7f1887f25700 1 -- 172.21.15.26:0/316651633 wait complete. 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.605+0000 7f1887f25700 1 Processor -- start 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 -- start start 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f18800b0140 0x7f1880150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f1880150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f188015a340 0x7f18800cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188006af70 con 0x7f18800ce4b0 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188006b1c0 con 0x7f188015a340 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1887f25700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188006b4a0 con 0x7f18800b0140 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f18854c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f1880150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f18854c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f1880150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38552/0 (socket says 172.21.15.26:38552) 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f18854c0700 1 -- 172.21.15.26:0/1380652636 learned_addr learned my addr 172.21.15.26:0/1380652636 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:40.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.606+0000 7f1885cc1700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f18800b0140 0x7f1880150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18864c2700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f188015a340 0x7f18800cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18854c0700 1 -- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f18800b0140 msgr2=0x7f1880150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18854c0700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f18800b0140 0x7f1880150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18854c0700 1 -- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f188015a340 msgr2=0x7f18800cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18854c0700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f188015a340 0x7f18800cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18854c0700 1 -- 172.21.15.26:0/1380652636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700094a0 con 0x7f18800ce4b0 2023-06-09T04:38:40.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f1885cc1700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f18800b0140 0x7f1880150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18854c0700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f1880150700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18700090b0 tx=0x7f1870004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700038a0 con 0x7f18800ce4b0 2023-06-09T04:38:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187001f070 con 0x7f18800ce4b0 2023-06-09T04:38:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188006b780 con 0x7f18800ce4b0 2023-06-09T04:38:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870003c00 con 0x7f18800ce4b0 2023-06-09T04:38:40.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.607+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1880150c40 con 0x7f18800ce4b0 2023-06-09T04:38:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.608+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188006bca0 con 0x7f18800ce4b0 2023-06-09T04:38:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.608+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f187001a430 con 0x7f18800ce4b0 2023-06-09T04:38:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.609+0000 7f18767fc700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f186406ace0 0x7f186406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.609+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1870021070 con 0x7f18800ce4b0 2023-06-09T04:38:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.609+0000 7f1885cc1700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f186406ace0 0x7f186406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.609+0000 7f1885cc1700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f186406ace0 0x7f186406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f187c009c10 tx=0x7f187c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.613+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f188006bca0 con 0x7f18800ce4b0 2023-06-09T04:38:40.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.810+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f188006bca0 con 0x7f18800ce4b0 2023-06-09T04:38:40.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.810+0000 7f18767fc700 1 -- 172.21.15.26:0/1380652636 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f188006bca0 con 0x7f18800ce4b0 2023-06-09T04:38:40.811 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f186406ace0 msgr2=0x7f186406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f186406ace0 0x7f186406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f187c009c10 tx=0x7f187c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 msgr2=0x7f1880150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f1880150700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18700090b0 tx=0x7f1870004750 comp rx=0 tx=0).stop 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 shutdown_connections 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f188015a340 0x7f18800cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f18800b0140 0x7f1880150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f186406ace0 0x7f186406d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 --2- 172.21.15.26:0/1380652636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18800ce4b0 0x7f1880150700 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 >> 172.21.15.26:0/1380652636 conn(0x7f1880089fc0 msgr2=0x7f1880157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 shutdown_connections 2023-06-09T04:38:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.812+0000 7f1887f25700 1 -- 172.21.15.26:0/1380652636 wait complete. 2023-06-09T04:38:40.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:40.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.949+0000 7f7207c37700 1 Processor -- start 2023-06-09T04:38:40.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.949+0000 7f7207c37700 1 -- start start 2023-06-09T04:38:40.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f7207c37700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f720006e990 0x7f720006a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f7207c37700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720006f190 con 0x7f72000aed50 2023-06-09T04:38:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f7207c37700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720006e440 con 0x7f720015c6e0 2023-06-09T04:38:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f7207c37700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720006e690 con 0x7f720006e990 2023-06-09T04:38:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72061d4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f720006e990 0x7f720006a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72051d2700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f72000aed50 0x7f7200069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47418/0 (socket says 172.21.15.26:47418) 2023-06-09T04:38:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72051d2700 1 -- 172.21.15.26:0/1591954946 learned_addr learned my addr 172.21.15.26:0/1591954946 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72061d4700 1 -- 172.21.15.26:0/1591954946 >> v1:172.21.15.104:6789/0 conn(0x7f720015c6e0 legacy=0x7f72000ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72061d4700 1 -- 172.21.15.26:0/1591954946 >> v1:172.21.15.26:6789/0 conn(0x7f72000aed50 legacy=0x7f7200069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72061d4700 1 -- 172.21.15.26:0/1591954946 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200160300 con 0x7f720006e990 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72049d1700 1 -- 172.21.15.26:0/1591954946 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620842328 0 0) 0x7f720006f190 con 0x7f72000aed50 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72061d4700 1 --2- 172.21.15.26:0/1591954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f720006e990 0x7f720006a4c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009d90 tx=0x7f71f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938a91980e9140d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72049d1700 1 -- 172.21.15.26:0/1591954946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800e070 con 0x7f720006e990 2023-06-09T04:38:40.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72049d1700 1 -- 172.21.15.26:0/1591954946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f800bbd0 con 0x7f720006e990 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.950+0000 7f72049d1700 1 -- 172.21.15.26:0/1591954946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8012430 con 0x7f720006e990 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 -- 172.21.15.26:0/1591954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f720006e990 msgr2=0x7f720006a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 --2- 172.21.15.26:0/1591954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f720006e990 0x7f720006a4c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009d90 tx=0x7f71f800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 -- 172.21.15.26:0/1591954946 shutdown_connections 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 --2- 172.21.15.26:0/1591954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f720006e990 0x7f720006a4c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 -- 172.21.15.26:0/1591954946 >> 172.21.15.26:0/1591954946 conn(0x7f7200098a30 msgr2=0x7f72000cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 -- 172.21.15.26:0/1591954946 shutdown_connections 2023-06-09T04:38:40.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.951+0000 7f7207c37700 1 -- 172.21.15.26:0/1591954946 wait complete. 2023-06-09T04:38:40.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.952+0000 7f7207c37700 1 Processor -- start 2023-06-09T04:38:40.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.952+0000 7f7207c37700 1 -- start start 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f7207c37700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f720006e990 0x7f72001474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f7207c37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 0x7f72000b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f7207c37700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f720015c6e0 0x7f7200157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f7207c37700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000c3900 con 0x7f72000aed50 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f7207c37700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000af910 con 0x7f720015c6e0 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f7207c37700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72000b0d70 con 0x7f720006e990 2023-06-09T04:38:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 0x7f72000b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 0x7f72000b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38566/0 (socket says 172.21.15.26:38566) 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 -- 172.21.15.26:0/673949545 learned_addr learned my addr 172.21.15.26:0/673949545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72059d3700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f720006e990 0x7f72001474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72061d4700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f720015c6e0 0x7f7200157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 -- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f720006e990 msgr2=0x7f72001474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f720006e990 0x7f72001474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 -- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f720015c6e0 msgr2=0x7f7200157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f720015c6e0 0x7f7200157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.953+0000 7f72051d2700 1 -- 172.21.15.26:0/673949545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8009a70 con 0x7f72000aed50 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.954+0000 7f72051d2700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 0x7f72000b1af0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f71f4001eb0 tx=0x7f71f400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.954+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4004c80 con 0x7f72000aed50 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.954+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f4004de0 con 0x7f72000aed50 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.954+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72000af630 con 0x7f72000aed50 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.954+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4007310 con 0x7f72000aed50 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.954+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72000b12f0 con 0x7f72000aed50 2023-06-09T04:38:40.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.955+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7200067180 con 0x7f72000aed50 2023-06-09T04:38:40.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.955+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71f4007470 con 0x7f72000aed50 2023-06-09T04:38:40.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.956+0000 7f71f27fc700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f71e406ace0 0x7f71e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.956+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71f40890b0 con 0x7f72000aed50 2023-06-09T04:38:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.956+0000 7f72059d3700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f71e406ace0 0x7f71e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.956+0000 7f72059d3700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f71e406ace0 0x7f71e406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000fb0 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:40.960+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71f4054160 con 0x7f72000aed50 2023-06-09T04:38:41.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.157+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72000ce6f0 con 0x7f72000aed50 2023-06-09T04:38:41.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.158+0000 7f71f27fc700 1 -- 172.21.15.26:0/673949545 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f71f4057780 con 0x7f72000aed50 2023-06-09T04:38:41.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:41.159 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:41.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f71e406ace0 msgr2=0x7f71e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f71e406ace0 0x7f71e406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000fb0 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2023-06-09T04:38:41.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 msgr2=0x7f72000b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 0x7f72000b1af0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f71f4001eb0 tx=0x7f71f400c800 comp rx=0 tx=0).stop 2023-06-09T04:38:41.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 shutdown_connections 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f720015c6e0 0x7f7200157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f720006e990 0x7f72001474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f71e406ace0 0x7f71e406d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 --2- 172.21.15.26:0/673949545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72000aed50 0x7f72000b1af0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 >> 172.21.15.26:0/673949545 conn(0x7f7200098a30 msgr2=0x7f72000cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 shutdown_connections 2023-06-09T04:38:41.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.161+0000 7f7207c37700 1 -- 172.21.15.26:0/673949545 wait complete. 2023-06-09T04:38:41.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:41.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:41.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.300+0000 7f86e7739700 1 Processor -- start 2023-06-09T04:38:41.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.301+0000 7f86e7739700 1 -- start start 2023-06-09T04:38:41.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.301+0000 7f86e7739700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86e00d0f80 0x7f86e0164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.301+0000 7f86e7739700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00ad470 con 0x7f86e00ceba0 2023-06-09T04:38:41.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.301+0000 7f86e7739700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00adff0 con 0x7f86e015d820 2023-06-09T04:38:41.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.301+0000 7f86e7739700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00cf040 con 0x7f86e00d0f80 2023-06-09T04:38:41.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86e00d0f80 0x7f86e0164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86e00d0f80 0x7f86e0164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38576/0 (socket says 172.21.15.26:38576) 2023-06-09T04:38:41.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e4cd4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f86e00ceba0 0x7f86e00d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47432/0 (socket says 172.21.15.26:47432) 2023-06-09T04:38:41.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 -- 172.21.15.26:0/1596340653 learned_addr learned my addr 172.21.15.26:0/1596340653 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:41.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 -- 172.21.15.26:0/1596340653 >> v1:172.21.15.104:6789/0 conn(0x7f86e015d820 legacy=0x7f86e00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 -- 172.21.15.26:0/1596340653 >> v1:172.21.15.26:6789/0 conn(0x7f86e00ceba0 legacy=0x7f86e00d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 -- 172.21.15.26:0/1596340653 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00b3730 con 0x7f86e00d0f80 2023-06-09T04:38:41.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86e5cd6700 1 --2- 172.21.15.26:0/1596340653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00d0f80 0x7f86e0164dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009e50 tx=0x7f86d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fd002a5c38877d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86d3fff700 1 -- 172.21.15.26:0/1596340653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800e070 con 0x7f86e00d0f80 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86d3fff700 1 -- 172.21.15.26:0/1596340653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800b9c0 con 0x7f86e00d0f80 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.302+0000 7f86d3fff700 1 -- 172.21.15.26:0/1596340653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800bd70 con 0x7f86e00d0f80 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 -- 172.21.15.26:0/1596340653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00d0f80 msgr2=0x7f86e0164dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 --2- 172.21.15.26:0/1596340653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00d0f80 0x7f86e0164dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009e50 tx=0x7f86d800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 -- 172.21.15.26:0/1596340653 shutdown_connections 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 --2- 172.21.15.26:0/1596340653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00d0f80 0x7f86e0164dd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 -- 172.21.15.26:0/1596340653 >> 172.21.15.26:0/1596340653 conn(0x7f86e0089fc0 msgr2=0x7f86e008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 -- 172.21.15.26:0/1596340653 shutdown_connections 2023-06-09T04:38:41.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.303+0000 7f86e7739700 1 -- 172.21.15.26:0/1596340653 wait complete. 2023-06-09T04:38:41.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.304+0000 7f86e7739700 1 Processor -- start 2023-06-09T04:38:41.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.304+0000 7f86e7739700 1 -- start start 2023-06-09T04:38:41.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e7739700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 0x7f86e00b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e7739700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e00d0f80 0x7f86e0156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e7739700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e015d820 0x7f86e0157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e7739700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e01576a0 con 0x7f86e00ceba0 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e7739700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00cce60 con 0x7f86e015d820 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e7739700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00cbdc0 con 0x7f86e00d0f80 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 0x7f86e00b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 0x7f86e00b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38578/0 (socket says 172.21.15.26:38578) 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 -- 172.21.15.26:0/234107722 learned_addr learned my addr 172.21.15.26:0/234107722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e5cd6700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e015d820 0x7f86e0157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e4cd4700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e00d0f80 0x7f86e0156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 -- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e00d0f80 msgr2=0x7f86e0156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e00d0f80 0x7f86e0156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 -- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e015d820 msgr2=0x7f86e0157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e015d820 0x7f86e0157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.305+0000 7f86e54d5700 1 -- 172.21.15.26:0/234107722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8009b30 con 0x7f86e00ceba0 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.306+0000 7f86e54d5700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 0x7f86e00b16e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c450 tx=0x7f86dc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.306+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0052d0 con 0x7f86e00ceba0 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.306+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc005430 con 0x7f86e00ceba0 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.306+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00cc0a0 con 0x7f86e00ceba0 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.306+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0038c0 con 0x7f86e00ceba0 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.306+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e00cc660 con 0x7f86e00ceba0 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.307+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e0066410 con 0x7f86e00ceba0 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.307+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86dc003a20 con 0x7f86e00ceba0 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.308+0000 7f86d1ffb700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f86c406ace0 0x7f86c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.308+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f86dc0887b0 con 0x7f86e00ceba0 2023-06-09T04:38:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.308+0000 7f86e4cd4700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f86c406ace0 0x7f86c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.309+0000 7f86e4cd4700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f86c406ace0 0x7f86c406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86e006d0a0 tx=0x7f86d4007ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.312+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86dc053850 con 0x7f86e00ceba0 2023-06-09T04:38:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.507+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86e00ae9e0 con 0x7f86e00ceba0 2023-06-09T04:38:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.507+0000 7f86d1ffb700 1 -- 172.21.15.26:0/234107722 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86dc00ce60 con 0x7f86e00ceba0 2023-06-09T04:38:41.507 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:41.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f86c406ace0 msgr2=0x7f86c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f86c406ace0 0x7f86c406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86e006d0a0 tx=0x7f86d4007ed0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 msgr2=0x7f86e00b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 0x7f86e00b16e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c450 tx=0x7f86dc00c760 comp rx=0 tx=0).stop 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 shutdown_connections 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e015d820 0x7f86e0157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f86c406ace0 0x7f86c406d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86e00ceba0 0x7f86e00b16e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 --2- 172.21.15.26:0/234107722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e00d0f80 0x7f86e0156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 >> 172.21.15.26:0/234107722 conn(0x7f86e0089fc0 msgr2=0x7f86e015ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 shutdown_connections 2023-06-09T04:38:41.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.509+0000 7f86e7739700 1 -- 172.21.15.26:0/234107722 wait complete. 2023-06-09T04:38:41.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:41.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.649+0000 7f098adc5700 1 Processor -- start 2023-06-09T04:38:41.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.649+0000 7f098adc5700 1 -- start start 2023-06-09T04:38:41.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f098adc5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09840aed50 0x7f0984069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f098adc5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f098406e990 0x7f098406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f098adc5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098406f190 con 0x7f098415c6e0 2023-06-09T04:38:41.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f098adc5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098406e440 con 0x7f098406e990 2023-06-09T04:38:41.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f098adc5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098406e690 con 0x7f09840aed50 2023-06-09T04:38:41.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0989362700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f098406e990 0x7f098406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0988b61700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f098415c6e0 0x7f09840ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47444/0 (socket says 172.21.15.26:47444) 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0988b61700 1 -- 172.21.15.26:0/5685644 learned_addr learned my addr 172.21.15.26:0/5685644 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0989362700 1 --2- 172.21.15.26:0/5685644 >> v2:172.21.15.26:3300/0 conn(0x7f098406e990 0x7f098406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38590/0 (socket says 172.21.15.26:38590) 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0983fff700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09840aed50 0x7f0984069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0989362700 1 -- 172.21.15.26:0/5685644 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09840aed50 msgr2=0x7f0984069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0989362700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09840aed50 0x7f0984069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0989362700 1 -- 172.21.15.26:0/5685644 >> v1:172.21.15.26:6789/0 conn(0x7f098415c6e0 legacy=0x7f09840ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0989362700 1 -- 172.21.15.26:0/5685644 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984160300 con 0x7f098406e990 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f09837fe700 1 -- 172.21.15.26:0/5685644 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347664843 0 0) 0x7f098406f190 con 0x7f098415c6e0 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.650+0000 7f0983fff700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09840aed50 0x7f0984069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f0989362700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f098406a2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b5d3d7a5f98e12 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f09837fe700 1 -- 172.21.15.26:0/5685644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00e070 con 0x7f098406e990 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f09837fe700 1 -- 172.21.15.26:0/5685644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00bbd0 con 0x7f098406e990 2023-06-09T04:38:41.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f09837fe700 1 -- 172.21.15.26:0/5685644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c012430 con 0x7f098406e990 2023-06-09T04:38:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 -- 172.21.15.26:0/5685644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 msgr2=0x7f098406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f098406a2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:41.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 -- 172.21.15.26:0/5685644 shutdown_connections 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f098406a2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 --2- 172.21.15.26:0/5685644 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f09840aed50 0x7f0984069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 -- 172.21.15.26:0/5685644 >> 172.21.15.26:0/5685644 conn(0x7f0984098a30 msgr2=0x7f09840cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 -- 172.21.15.26:0/5685644 shutdown_connections 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.651+0000 7f098adc5700 1 -- 172.21.15.26:0/5685644 wait complete. 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.653+0000 7f098adc5700 1 Processor -- start 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.653+0000 7f098adc5700 1 -- start start 2023-06-09T04:38:41.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f0984153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09840aed50 0x7f0984154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f098415c6e0 0x7f09841f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09841f2d50 con 0x7f098406e990 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984154af0 con 0x7f09840aed50 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0984154390 con 0x7f098415c6e0 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f0984153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f0984153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38592/0 (socket says 172.21.15.26:38592) 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 -- 172.21.15.26:0/238157958 learned_addr learned my addr 172.21.15.26:0/238157958 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 -- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f098415c6e0 msgr2=0x7f09841f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f098415c6e0 0x7f09841f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 -- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09840aed50 msgr2=0x7f0984154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09840aed50 0x7f0984154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 -- 172.21.15.26:0/238157958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009a70 con 0x7f098406e990 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f0988b61700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f0984153e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09780010e0 tx=0x7f097800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780074e0 con 0x7f098406e990 2023-06-09T04:38:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978007660 con 0x7f098406e990 2023-06-09T04:38:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09841f2790 con 0x7f098406e990 2023-06-09T04:38:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978005a70 con 0x7f098406e990 2023-06-09T04:38:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.654+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0984154780 con 0x7f098406e990 2023-06-09T04:38:41.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.655+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0984067180 con 0x7f098406e990 2023-06-09T04:38:41.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.656+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0978005bd0 con 0x7f098406e990 2023-06-09T04:38:41.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.656+0000 7f09817fa700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f096806ace0 0x7f096806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.656+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0978088980 con 0x7f098406e990 2023-06-09T04:38:41.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.656+0000 7f0983fff700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f096806ace0 0x7f096806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.657+0000 7f0983fff700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f096806ace0 0x7f096806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09841586e0 tx=0x7f0970008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.660+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0978053a30 con 0x7f098406e990 2023-06-09T04:38:41.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.855+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09840ce6f0 con 0x7f098406e990 2023-06-09T04:38:41.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.856+0000 7f09817fa700 1 -- 172.21.15.26:0/238157958 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09780170a0 con 0x7f098406e990 2023-06-09T04:38:41.856 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f096806ace0 msgr2=0x7f096806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f096806ace0 0x7f096806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09841586e0 tx=0x7f0970008040 comp rx=0 tx=0).stop 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 msgr2=0x7f0984153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f0984153e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09780010e0 tx=0x7f097800c860 comp rx=0 tx=0).stop 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 shutdown_connections 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f098415c6e0 0x7f09841f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f096806ace0 0x7f096806d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f098406e990 0x7f0984153e50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 --2- 172.21.15.26:0/238157958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09840aed50 0x7f0984154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.857+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 >> 172.21.15.26:0/238157958 conn(0x7f0984098a30 msgr2=0x7f098406a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.858+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 shutdown_connections 2023-06-09T04:38:41.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.858+0000 7f098adc5700 1 -- 172.21.15.26:0/238157958 wait complete. 2023-06-09T04:38:41.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:41.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.997+0000 7ffae2273700 1 Processor -- start 2023-06-09T04:38:41.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.997+0000 7ffae2273700 1 -- start start 2023-06-09T04:38:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae2273700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc15c6e0 0x7ffadc0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae2273700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffadc06e990 0x7ffadc0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae2273700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffadc098e30 0x7ffadc0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae2273700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc06f190 con 0x7ffadc098e30 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae2273700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc06e440 con 0x7ffadc06e990 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae2273700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc06e690 con 0x7ffadc15c6e0 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffadc098e30 0x7ffadc0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffadc098e30 0x7ffadc0cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38604/0 (socket says 172.21.15.26:38604) 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 -- 172.21.15.26:0/2793756866 learned_addr learned my addr 172.21.15.26:0/2793756866 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:41.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffadbfff700 1 --2- 172.21.15.26:0/2793756866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc15c6e0 0x7ffadc0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 -- 172.21.15.26:0/2793756866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc15c6e0 msgr2=0x7ffadc0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffadb7fe700 1 --2- 172.21.15.26:0/2793756866 >> v2:172.21.15.104:3300/0 conn(0x7ffadc06e990 0x7ffadc0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 --2- 172.21.15.26:0/2793756866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc15c6e0 0x7ffadc0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 -- 172.21.15.26:0/2793756866 >> v2:172.21.15.104:3300/0 conn(0x7ffadc06e990 msgr2=0x7ffadc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 --2- 172.21.15.26:0/2793756866 >> v2:172.21.15.104:3300/0 conn(0x7ffadc06e990 0x7ffadc0aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 -- 172.21.15.26:0/2793756866 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc160300 con 0x7ffadc098e30 2023-06-09T04:38:42.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffae0810700 1 --2- 172.21.15.26:0/2793756866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc098e30 0x7ffadc0cd6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0b23d0 tx=0x7ffad400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267a80434f0c0722 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffadaffd700 1 -- 172.21.15.26:0/2793756866 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400e070 con 0x7ffadc098e30 2023-06-09T04:38:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffadaffd700 1 -- 172.21.15.26:0/2793756866 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad400b9c0 con 0x7ffadc098e30 2023-06-09T04:38:42.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.998+0000 7ffadaffd700 1 -- 172.21.15.26:0/2793756866 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400bd70 con 0x7ffadc098e30 2023-06-09T04:38:42.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 -- 172.21.15.26:0/2793756866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc098e30 msgr2=0x7ffadc0cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 --2- 172.21.15.26:0/2793756866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc098e30 0x7ffadc0cd6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0b23d0 tx=0x7ffad400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:42.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 -- 172.21.15.26:0/2793756866 shutdown_connections 2023-06-09T04:38:42.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 --2- 172.21.15.26:0/2793756866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc098e30 0x7ffadc0cd6e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 --2- 172.21.15.26:0/2793756866 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc15c6e0 0x7ffadc0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 --2- 172.21.15.26:0/2793756866 >> v2:172.21.15.104:3300/0 conn(0x7ffadc06e990 0x7ffadc0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 -- 172.21.15.26:0/2793756866 >> 172.21.15.26:0/2793756866 conn(0x7ffadc098a30 msgr2=0x7ffadc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 -- 172.21.15.26:0/2793756866 shutdown_connections 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:41.999+0000 7ffae2273700 1 -- 172.21.15.26:0/2793756866 wait complete. 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.000+0000 7ffae2273700 1 Processor -- start 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.000+0000 7ffae2273700 1 -- start start 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae2273700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc06e990 0x7ffadc0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae2273700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffadc098e30 0x7ffadc153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae2273700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 0x7ffadc0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae2273700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0af570 con 0x7ffadc15c6e0 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae2273700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0c5d80 con 0x7ffadc098e30 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae2273700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0c6060 con 0x7ffadc06e990 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae0810700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 0x7ffadc0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae0810700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 0x7ffadc0b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38610/0 (socket says 172.21.15.26:38610) 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffae0810700 1 -- 172.21.15.26:0/4084080377 learned_addr learned my addr 172.21.15.26:0/4084080377 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:42.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffadbfff700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc06e990 0x7ffadc0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.001+0000 7ffadb7fe700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffadc098e30 0x7ffadc153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae0810700 1 -- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc06e990 msgr2=0x7ffadc0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae0810700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc06e990 0x7ffadc0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae0810700 1 -- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffadc098e30 msgr2=0x7ffadc153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae0810700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffadc098e30 0x7ffadc153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae0810700 1 -- 172.21.15.26:0/4084080377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4009b30 con 0x7ffadc15c6e0 2023-06-09T04:38:42.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffadb7fe700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffadc098e30 0x7ffadc153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae0810700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 0x7ffadc0b48a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffad400b370 tx=0x7ffad4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4004250 con 0x7ffadc15c6e0 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad40043b0 con 0x7ffadc15c6e0 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0c6340 con 0x7ffadc15c6e0 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4004760 con 0x7ffadc15c6e0 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.002+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc154200 con 0x7ffadc15c6e0 2023-06-09T04:38:42.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.003+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc0c9ce0 con 0x7ffadc15c6e0 2023-06-09T04:38:42.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.003+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffad401b430 con 0x7ffadc15c6e0 2023-06-09T04:38:42.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.004+0000 7ffad8ff9700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffac806ace0 0x7ffac806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.004+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffad408a6e0 con 0x7ffadc15c6e0 2023-06-09T04:38:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.004+0000 7ffadbfff700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffac806ace0 0x7ffac806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.004+0000 7ffadbfff700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffac806ace0 0x7ffac806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00aa20 tx=0x7ffacc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.008+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffad4055830 con 0x7ffadc15c6e0 2023-06-09T04:38:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.207+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffadc0ca290 con 0x7ffadc15c6e0 2023-06-09T04:38:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.207+0000 7ffad8ff9700 1 -- 172.21.15.26:0/4084080377 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffad4058e50 con 0x7ffadc15c6e0 2023-06-09T04:38:42.208 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:42.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffac806ace0 msgr2=0x7ffac806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffac806ace0 0x7ffac806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00aa20 tx=0x7ffacc008040 comp rx=0 tx=0).stop 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 msgr2=0x7ffadc0b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 0x7ffadc0b48a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffad400b370 tx=0x7ffad4004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 shutdown_connections 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ffac806ace0 0x7ffac806d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffadc15c6e0 0x7ffadc0b48a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffadc06e990 0x7ffadc0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 --2- 172.21.15.26:0/4084080377 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffadc098e30 0x7ffadc153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 >> 172.21.15.26:0/4084080377 conn(0x7ffadc098a30 msgr2=0x7ffadc0cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 shutdown_connections 2023-06-09T04:38:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.209+0000 7ffae2273700 1 -- 172.21.15.26:0/4084080377 wait complete. 2023-06-09T04:38:42.221 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.348+0000 7f2dcd1ca700 1 Processor -- start 2023-06-09T04:38:42.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.348+0000 7f2dcd1ca700 1 -- start start 2023-06-09T04:38:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dcd1ca700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2dc815a5b0 0x7f2dc815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dcd1ca700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2dc80b1240 0x7f2dc80b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dcd1ca700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc815ae10 con 0x7f2dc80ce520 2023-06-09T04:38:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dcd1ca700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc80aeff0 con 0x7f2dc80b1240 2023-06-09T04:38:42.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dcd1ca700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc80b1d00 con 0x7f2dc815a5b0 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dc759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2dc80b1240 0x7f2dc80b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dc6d9d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2dc80ce520 0x7f2dc80ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47472/0 (socket says 172.21.15.26:47472) 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.349+0000 7f2dc6d9d700 1 -- 172.21.15.26:0/122516351 learned_addr learned my addr 172.21.15.26:0/122516351 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc659c700 1 --2- 172.21.15.26:0/122516351 >> v2:172.21.15.104:3300/0 conn(0x7f2dc815a5b0 0x7f2dc815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc759e700 1 -- 172.21.15.26:0/122516351 >> v2:172.21.15.104:3300/0 conn(0x7f2dc815a5b0 msgr2=0x7f2dc815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc759e700 1 --2- 172.21.15.26:0/122516351 >> v2:172.21.15.104:3300/0 conn(0x7f2dc815a5b0 0x7f2dc815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc759e700 1 -- 172.21.15.26:0/122516351 >> v1:172.21.15.26:6789/0 conn(0x7f2dc80ce520 legacy=0x7f2dc80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc759e700 1 -- 172.21.15.26:0/122516351 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80b1fe0 con 0x7f2dc80b1240 2023-06-09T04:38:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc759e700 1 --2- 172.21.15.26:0/122516351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc80b16e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80ca670 tx=0x7f2dc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b744409466c9719a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc5d9b700 1 -- 172.21.15.26:0/122516351 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000e070 con 0x7f2dc80b1240 2023-06-09T04:38:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc5d9b700 1 -- 172.21.15.26:0/122516351 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000bbd0 con 0x7f2dc80b1240 2023-06-09T04:38:42.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dc5d9b700 1 -- 172.21.15.26:0/122516351 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0012430 con 0x7f2dc80b1240 2023-06-09T04:38:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/122516351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 msgr2=0x7f2dc80b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.350+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/122516351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc80b16e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80ca670 tx=0x7f2dc000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.351+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/122516351 shutdown_connections 2023-06-09T04:38:42.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.351+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/122516351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc80b16e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.351+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/122516351 >> v2:172.21.15.104:3300/0 conn(0x7f2dc815a5b0 0x7f2dc815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.351+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/122516351 >> 172.21.15.26:0/122516351 conn(0x7f2dc8098b50 msgr2=0x7f2dc80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.351+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/122516351 shutdown_connections 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.351+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/122516351 wait complete. 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.352+0000 7f2dcd1ca700 1 Processor -- start 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.352+0000 7f2dcd1ca700 1 -- start start 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dcd1ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc81e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dcd1ca700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2dc80ce520 0x7f2dc814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dcd1ca700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc815a5b0 0x7f2dc814f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dcd1ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81500f0 con 0x7f2dc80b1240 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dcd1ca700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81e3430 con 0x7f2dc815a5b0 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dcd1ca700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80cafb0 con 0x7f2dc80ce520 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc81e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc81e2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38622/0 (socket says 172.21.15.26:38622) 2023-06-09T04:38:42.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 -- 172.21.15.26:0/2348247974 learned_addr learned my addr 172.21.15.26:0/2348247974 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc759e700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc815a5b0 0x7f2dc814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc659c700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2dc80ce520 0x7f2dc814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 -- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2dc80ce520 msgr2=0x7f2dc814e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2dc80ce520 0x7f2dc814e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 -- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc815a5b0 msgr2=0x7f2dc814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc815a5b0 0x7f2dc814f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc6d9d700 1 -- 172.21.15.26:0/2348247974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009a70 con 0x7f2dc80b1240 2023-06-09T04:38:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.353+0000 7f2dc759e700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc815a5b0 0x7f2dc814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.354+0000 7f2dc6d9d700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc81e2dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c700 tx=0x7f2dbc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.354+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0074e0 con 0x7f2dc80b1240 2023-06-09T04:38:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.354+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc007640 con 0x7f2dc80b1240 2023-06-09T04:38:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.354+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc80cb290 con 0x7f2dc80b1240 2023-06-09T04:38:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.354+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc005a30 con 0x7f2dc80b1240 2023-06-09T04:38:42.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.354+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc80cb850 con 0x7f2dc80b1240 2023-06-09T04:38:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.355+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc8067180 con 0x7f2dc80b1240 2023-06-09T04:38:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.355+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2dbc005b90 con 0x7f2dc80b1240 2023-06-09T04:38:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.355+0000 7f2daf7fe700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2db406ace0 0x7f2db406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.356+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2dbc088830 con 0x7f2dc80b1240 2023-06-09T04:38:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.356+0000 7f2dc659c700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2db406ace0 0x7f2db406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.356+0000 7f2dc659c700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2db406ace0 0x7f2db406d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80ccb60 tx=0x7f2db8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.360+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2dbc0539a0 con 0x7f2dc80b1240 2023-06-09T04:38:42.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.558+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2dc8071ec0 con 0x7f2dc80b1240 2023-06-09T04:38:42.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.559+0000 7f2daf7fe700 1 -- 172.21.15.26:0/2348247974 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2dbc056fc0 con 0x7f2dc80b1240 2023-06-09T04:38:42.559 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:42.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2db406ace0 msgr2=0x7f2db406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2db406ace0 0x7f2db406d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80ccb60 tx=0x7f2db8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 msgr2=0x7f2dc81e2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc81e2dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c700 tx=0x7f2dbc00cac0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 shutdown_connections 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc815a5b0 0x7f2dc814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f2db406ace0 0x7f2db406d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2dc80b1240 0x7f2dc81e2dc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 --2- 172.21.15.26:0/2348247974 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2dc80ce520 0x7f2dc814e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 >> 172.21.15.26:0/2348247974 conn(0x7f2dc8098b50 msgr2=0x7f2dc80ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 shutdown_connections 2023-06-09T04:38:42.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.561+0000 7f2dcd1ca700 1 -- 172.21.15.26:0/2348247974 wait complete. 2023-06-09T04:38:42.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.697+0000 7efc6afa2700 1 Processor -- start 2023-06-09T04:38:42.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.697+0000 7efc6afa2700 1 -- start start 2023-06-09T04:38:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc6afa2700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640aed90 0x7efc640c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc6afa2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc640ca370 0x7efc640ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc6afa2700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc64159880 con 0x7efc640ceae0 2023-06-09T04:38:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc6afa2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc640cda30 con 0x7efc640ca370 2023-06-09T04:38:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc6afa2700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640ca7e0 con 0x7efc640aed90 2023-06-09T04:38:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc640ca370 0x7efc640ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc640ca370 0x7efc640ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38628/0 (socket says 172.21.15.26:38628) 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 -- 172.21.15.26:0/1341600662 learned_addr learned my addr 172.21.15.26:0/1341600662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc68d3e700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640aed90 0x7efc640c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 -- 172.21.15.26:0/1341600662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640aed90 msgr2=0x7efc640c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640aed90 0x7efc640c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 -- 172.21.15.26:0/1341600662 >> v1:172.21.15.26:6789/0 conn(0x7efc640ceae0 legacy=0x7efc640cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc637fe700 1 -- 172.21.15.26:0/1341600662 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050332017 0 0) 0x7efc64159880 con 0x7efc640ceae0 2023-06-09T04:38:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc63fff700 1 -- 172.21.15.26:0/1341600662 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6406cff0 con 0x7efc640ca370 2023-06-09T04:38:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.698+0000 7efc68d3e700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640aed90 0x7efc640c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc63fff700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640ca370 0x7efc640ce5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efc5000bbc0 tx=0x7efc5000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f028a9043bf0c3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc637fe700 1 -- 172.21.15.26:0/1341600662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5000dd50 con 0x7efc640ca370 2023-06-09T04:38:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc637fe700 1 -- 172.21.15.26:0/1341600662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50010470 con 0x7efc640ca370 2023-06-09T04:38:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc637fe700 1 -- 172.21.15.26:0/1341600662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50010800 con 0x7efc640ca370 2023-06-09T04:38:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 -- 172.21.15.26:0/1341600662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640ca370 msgr2=0x7efc640ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640ca370 0x7efc640ce5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efc5000bbc0 tx=0x7efc5000bed0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 -- 172.21.15.26:0/1341600662 shutdown_connections 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640aed90 0x7efc640c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1341600662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640ca370 0x7efc640ce5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 -- 172.21.15.26:0/1341600662 >> 172.21.15.26:0/1341600662 conn(0x7efc64098a30 msgr2=0x7efc640cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 -- 172.21.15.26:0/1341600662 shutdown_connections 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.699+0000 7efc6afa2700 1 -- 172.21.15.26:0/1341600662 wait complete. 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.700+0000 7efc6afa2700 1 Processor -- start 2023-06-09T04:38:42.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 -- start start 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 0x7efc640b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640ca370 0x7efc64154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc640ceae0 0x7efc640b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc640b2090 con 0x7efc640aed90 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc640b3be0 con 0x7efc640ceae0 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc6afa2700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640b3ec0 con 0x7efc640ca370 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.701+0000 7efc68d3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 0x7efc640b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 0x7efc640b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38634/0 (socket says 172.21.15.26:38634) 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 -- 172.21.15.26:0/1909339227 learned_addr learned my addr 172.21.15.26:0/1909339227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc63fff700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640ca370 0x7efc64154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 -- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640ca370 msgr2=0x7efc64154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640ca370 0x7efc64154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 -- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc640ceae0 msgr2=0x7efc640b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc640ceae0 0x7efc640b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 -- 172.21.15.26:0/1909339227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5000b7f0 con 0x7efc640aed90 2023-06-09T04:38:42.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc68d3e700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 0x7efc640b1b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e810 tx=0x7efc5800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58005c20 con 0x7efc640aed90 2023-06-09T04:38:42.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58005d80 con 0x7efc640aed90 2023-06-09T04:38:42.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc640b41a0 con 0x7efc640aed90 2023-06-09T04:38:42.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58006250 con 0x7efc640aed90 2023-06-09T04:38:42.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.702+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc640b4760 con 0x7efc640aed90 2023-06-09T04:38:42.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.703+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc640cdb70 con 0x7efc640aed90 2023-06-09T04:38:42.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.704+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc580063b0 con 0x7efc640aed90 2023-06-09T04:38:42.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.704+0000 7efc617fa700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc4806ace0 0x7efc4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.704+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc58088e40 con 0x7efc640aed90 2023-06-09T04:38:42.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.704+0000 7efc63fff700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc4806ace0 0x7efc4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.705+0000 7efc63fff700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc4806ace0 0x7efc4806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc5000b340 tx=0x7efc5001b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.709+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efc58053f80 con 0x7efc640aed90 2023-06-09T04:38:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.905+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc6404e8e0 con 0x7efc640aed90 2023-06-09T04:38:42.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.906+0000 7efc617fa700 1 -- 172.21.15.26:0/1909339227 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7efc58020090 con 0x7efc640aed90 2023-06-09T04:38:42.907 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:42.907 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:42.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc4806ace0 msgr2=0x7efc4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc4806ace0 0x7efc4806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc5000b340 tx=0x7efc5001b040 comp rx=0 tx=0).stop 2023-06-09T04:38:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 msgr2=0x7efc640b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 0x7efc640b1b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e810 tx=0x7efc5800ebd0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 shutdown_connections 2023-06-09T04:38:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc640ceae0 0x7efc640b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc4806ace0 0x7efc4806d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc640aed90 0x7efc640b1b50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 --2- 172.21.15.26:0/1909339227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc640ca370 0x7efc64154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 >> 172.21.15.26:0/1909339227 conn(0x7efc64098a30 msgr2=0x7efc640cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 shutdown_connections 2023-06-09T04:38:42.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:42.908+0000 7efc6afa2700 1 -- 172.21.15.26:0/1909339227 wait complete. 2023-06-09T04:38:42.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:42.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:43.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.050+0000 7f7853d65700 1 Processor -- start 2023-06-09T04:38:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.050+0000 7f7853d65700 1 -- start start 2023-06-09T04:38:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7853d65700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f784c15c6e0 0x7f784c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7853d65700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f784c098e30 0x7f784c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7853d65700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c06f190 con 0x7f784c06e990 2023-06-09T04:38:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7853d65700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c06e440 con 0x7f784c15c6e0 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7853d65700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c06e690 con 0x7f784c098e30 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f784c15c6e0 0x7f784c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f784c15c6e0 0x7f784c0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38642/0 (socket says 172.21.15.26:38642) 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 -- 172.21.15.26:0/2682661160 learned_addr learned my addr 172.21.15.26:0/2682661160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851300700 1 --1- 172.21.15.26:0/2682661160 >> v1:172.21.15.26:6789/0 conn(0x7f784c06e990 0x7f784c0cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47500/0 (socket says 172.21.15.26:47500) 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7852302700 1 --2- 172.21.15.26:0/2682661160 >> v2:172.21.15.104:3300/0 conn(0x7f784c098e30 0x7f784c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 -- 172.21.15.26:0/2682661160 >> v2:172.21.15.104:3300/0 conn(0x7f784c098e30 msgr2=0x7f784c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 --2- 172.21.15.26:0/2682661160 >> v2:172.21.15.104:3300/0 conn(0x7f784c098e30 0x7f784c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 -- 172.21.15.26:0/2682661160 >> v1:172.21.15.26:6789/0 conn(0x7f784c06e990 legacy=0x7f784c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7850aff700 1 -- 172.21.15.26:0/2682661160 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292397314 0 0) 0x7f784c06f190 con 0x7f784c06e990 2023-06-09T04:38:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 -- 172.21.15.26:0/2682661160 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c160300 con 0x7f784c15c6e0 2023-06-09T04:38:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7851b01700 1 --2- 172.21.15.26:0/2682661160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0ae640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f784c072140 tx=0x7f7848009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d29258d7c5590f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7850aff700 1 -- 172.21.15.26:0/2682661160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848005e30 con 0x7f784c15c6e0 2023-06-09T04:38:43.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7850aff700 1 -- 172.21.15.26:0/2682661160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7848004030 con 0x7f784c15c6e0 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.051+0000 7f7850aff700 1 -- 172.21.15.26:0/2682661160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78480043e0 con 0x7f784c15c6e0 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 -- 172.21.15.26:0/2682661160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 msgr2=0x7f784c0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 --2- 172.21.15.26:0/2682661160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0ae640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f784c072140 tx=0x7f7848009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 -- 172.21.15.26:0/2682661160 shutdown_connections 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 --2- 172.21.15.26:0/2682661160 >> v2:172.21.15.104:3300/0 conn(0x7f784c098e30 0x7f784c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 --2- 172.21.15.26:0/2682661160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0ae640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 -- 172.21.15.26:0/2682661160 >> 172.21.15.26:0/2682661160 conn(0x7f784c098a30 msgr2=0x7f784c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 -- 172.21.15.26:0/2682661160 shutdown_connections 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.052+0000 7f7853d65700 1 -- 172.21.15.26:0/2682661160 wait complete. 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.053+0000 7f7853d65700 1 Processor -- start 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.053+0000 7f7853d65700 1 -- start start 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7853d65700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f784c06e990 0x7f784c0b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7853d65700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f784c098e30 0x7f784c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7853d65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7853d65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1f2fd0 con 0x7f784c15c6e0 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7853d65700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0b2120 con 0x7f784c098e30 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7853d65700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c154590 con 0x7f784c06e990 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7852302700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7852302700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38650/0 (socket says 172.21.15.26:38650) 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7852302700 1 -- 172.21.15.26:0/1831082707 learned_addr learned my addr 172.21.15.26:0/1831082707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7851b01700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f784c06e990 0x7f784c0b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.054+0000 7f7851300700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f784c098e30 0x7f784c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7852302700 1 -- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f784c06e990 msgr2=0x7f784c0b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7852302700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f784c06e990 0x7f784c0b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7852302700 1 -- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f784c098e30 msgr2=0x7f784c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7852302700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f784c098e30 0x7f784c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7852302700 1 -- 172.21.15.26:0/1831082707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848009500 con 0x7f784c15c6e0 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7852302700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0cbeb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7844007e60 tx=0x7f784400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784400ed30 con 0x7f784c15c6e0 2023-06-09T04:38:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844014420 con 0x7f784c15c6e0 2023-06-09T04:38:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c1f2350 con 0x7f784c15c6e0 2023-06-09T04:38:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440147d0 con 0x7f784c15c6e0 2023-06-09T04:38:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.055+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c1f2910 con 0x7f784c15c6e0 2023-06-09T04:38:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.056+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c1f3110 con 0x7f784c15c6e0 2023-06-09T04:38:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.056+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7844014930 con 0x7f784c15c6e0 2023-06-09T04:38:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.057+0000 7f78427fc700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f783006ace0 0x7f783006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.057+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7844089ba0 con 0x7f784c15c6e0 2023-06-09T04:38:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.057+0000 7f7851b01700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f783006ace0 0x7f783006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.057+0000 7f7851b01700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f783006ace0 0x7f783006d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f784c072140 tx=0x7f7848008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.061+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f784c1f3110 con 0x7f784c15c6e0 2023-06-09T04:38:43.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.259+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f784c1f3110 con 0x7f784c15c6e0 2023-06-09T04:38:43.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.259+0000 7f78427fc700 1 -- 172.21.15.26:0/1831082707 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7844054c60 con 0x7f784c15c6e0 2023-06-09T04:38:43.259 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f783006ace0 msgr2=0x7f783006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f783006ace0 0x7f783006d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f784c072140 tx=0x7f7848008070 comp rx=0 tx=0).stop 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 msgr2=0x7f784c0cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0cbeb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7844007e60 tx=0x7f784400e3c0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 shutdown_connections 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f783006ace0 0x7f783006d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f784c15c6e0 0x7f784c0cbeb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f784c06e990 0x7f784c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 --2- 172.21.15.26:0/1831082707 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f784c098e30 0x7f784c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 >> 172.21.15.26:0/1831082707 conn(0x7f784c098a30 msgr2=0x7f784c0ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 shutdown_connections 2023-06-09T04:38:43.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.261+0000 7f7853d65700 1 -- 172.21.15.26:0/1831082707 wait complete. 2023-06-09T04:38:43.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:43.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.400+0000 7f6599763700 1 Processor -- start 2023-06-09T04:38:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6599763700 1 -- start start 2023-06-09T04:38:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6599763700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65941569b0 0x7f65940cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6599763700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f65940cf370 0x7f65940d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6599763700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659415d950 con 0x7f659415d3e0 2023-06-09T04:38:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6599763700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940d0970 con 0x7f65941569b0 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6599763700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940cd360 con 0x7f65940cf370 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6592ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65941569b0 0x7f65940cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6592ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65941569b0 0x7f65940cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38654/0 (socket says 172.21.15.26:38654) 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.401+0000 7f6592ffd700 1 -- 172.21.15.26:0/1327129879 learned_addr learned my addr 172.21.15.26:0/1327129879 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f65927fc700 1 --2- 172.21.15.26:0/1327129879 >> v2:172.21.15.104:3300/0 conn(0x7f65940cf370 0x7f65940d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6592ffd700 1 -- 172.21.15.26:0/1327129879 >> v2:172.21.15.104:3300/0 conn(0x7f65940cf370 msgr2=0x7f65940d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6592ffd700 1 --2- 172.21.15.26:0/1327129879 >> v2:172.21.15.104:3300/0 conn(0x7f65940cf370 0x7f65940d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6592ffd700 1 -- 172.21.15.26:0/1327129879 >> v1:172.21.15.104:6789/0 conn(0x7f659415d3e0 legacy=0x7f65940b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6592ffd700 1 -- 172.21.15.26:0/1327129879 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940cd640 con 0x7f65941569b0 2023-06-09T04:38:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6592ffd700 1 --2- 172.21.15.26:0/1327129879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65941569b0 0x7f65940cee30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65940d2ac0 tx=0x7f6588009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7df4af169e8081b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6591ffb700 1 -- 172.21.15.26:0/1327129879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588005e30 con 0x7f65941569b0 2023-06-09T04:38:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6591ffb700 1 -- 172.21.15.26:0/1327129879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588004030 con 0x7f65941569b0 2023-06-09T04:38:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.402+0000 7f6591ffb700 1 -- 172.21.15.26:0/1327129879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880043e0 con 0x7f65941569b0 2023-06-09T04:38:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 -- 172.21.15.26:0/1327129879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65941569b0 msgr2=0x7f65940cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 --2- 172.21.15.26:0/1327129879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65941569b0 0x7f65940cee30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65940d2ac0 tx=0x7f6588009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 -- 172.21.15.26:0/1327129879 shutdown_connections 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 --2- 172.21.15.26:0/1327129879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65941569b0 0x7f65940cee30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 --2- 172.21.15.26:0/1327129879 >> v2:172.21.15.104:3300/0 conn(0x7f65940cf370 0x7f65940d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 -- 172.21.15.26:0/1327129879 >> 172.21.15.26:0/1327129879 conn(0x7f659406b1f0 msgr2=0x7f659406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 -- 172.21.15.26:0/1327129879 shutdown_connections 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.403+0000 7f6599763700 1 -- 172.21.15.26:0/1327129879 wait complete. 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.404+0000 7f6599763700 1 Processor -- start 2023-06-09T04:38:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 -- start start 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 0x7f6594154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f65941569b0 0x7f65940c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f659415d3e0 0x7f65940c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c7200 con 0x7f65940cf370 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c74d0 con 0x7f659415d3e0 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.405+0000 7f6599763700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c7c30 con 0x7f65941569b0 2023-06-09T04:38:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 0x7f6594154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 0x7f6594154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38660/0 (socket says 172.21.15.26:38660) 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 -- 172.21.15.26:0/759964933 learned_addr learned my addr 172.21.15.26:0/759964933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 -- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f65941569b0 msgr2=0x7f65940c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f65941569b0 0x7f65940c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 -- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f659415d3e0 msgr2=0x7f65940c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f659415d3e0 0x7f65940c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 -- 172.21.15.26:0/759964933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009500 con 0x7f65940cf370 2023-06-09T04:38:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6592ffd700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 0x7f6594154bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6588009c10 tx=0x7f6588004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588003dd0 con 0x7f65940cf370 2023-06-09T04:38:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588011420 con 0x7f65940cf370 2023-06-09T04:38:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880117b0 con 0x7f65940cf370 2023-06-09T04:38:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65940c7f10 con 0x7f65940cf370 2023-06-09T04:38:43.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.406+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65941550f0 con 0x7f65940cf370 2023-06-09T04:38:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.407+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65940c8430 con 0x7f65940cf370 2023-06-09T04:38:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.408+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6588011910 con 0x7f65940cf370 2023-06-09T04:38:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.408+0000 7f657b7fe700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f658006ace0 0x7f658006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.408+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f658808a6b0 con 0x7f65940cf370 2023-06-09T04:38:43.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.408+0000 7f65927fc700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f658006ace0 0x7f658006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.409+0000 7f65927fc700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f658006ace0 0x7f658006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659415c2e0 tx=0x7f6584008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.413+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f65940c8430 con 0x7f65940cf370 2023-06-09T04:38:43.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.609+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65940c8430 con 0x7f65940cf370 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.609+0000 7f657b7fe700 1 -- 172.21.15.26:0/759964933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65940c8430 con 0x7f65940cf370 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:43.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f658006ace0 msgr2=0x7f658006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f658006ace0 0x7f658006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659415c2e0 tx=0x7f6584008040 comp rx=0 tx=0).stop 2023-06-09T04:38:43.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 msgr2=0x7f6594154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 0x7f6594154bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6588009c10 tx=0x7f6588004750 comp rx=0 tx=0).stop 2023-06-09T04:38:43.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 shutdown_connections 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f659415d3e0 0x7f65940c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f658006ace0 0x7f658006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65940cf370 0x7f6594154bb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 --2- 172.21.15.26:0/759964933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f65941569b0 0x7f65940c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 >> 172.21.15.26:0/759964933 conn(0x7f659406b1f0 msgr2=0x7f659415fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 shutdown_connections 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.612+0000 7f6599763700 1 -- 172.21.15.26:0/759964933 wait complete. 2023-06-09T04:38:43.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:43.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.750+0000 7f929d262700 1 Processor -- start 2023-06-09T04:38:43.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.750+0000 7f929d262700 1 -- start start 2023-06-09T04:38:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f929d262700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f92980ce5e0 0x7f92980cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f929d262700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929815e8d0 con 0x7f9298154b30 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f929d262700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929815ebb0 con 0x7f92980cdaa0 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f929d262700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980cb5c0 con 0x7f92980ce5e0 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f9296ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9298154b30 0x7f92980cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47526/0 (socket says 172.21.15.26:47526) 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f9296ffd700 1 -- 172.21.15.26:0/4163470234 learned_addr learned my addr 172.21.15.26:0/4163470234 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f92967fc700 1 --2- 172.21.15.26:0/4163470234 >> v2:172.21.15.104:3300/0 conn(0x7f92980ce5e0 0x7f92980cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891697060 0 0) 0x7f929815e8d0 con 0x7f9298154b30 2023-06-09T04:38:43.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.751+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92800035b0 con 0x7f9298154b30 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661490235 0 0) 0x7f929815ebb0 con 0x7f92980cdaa0 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f929815e8d0 con 0x7f92980cdaa0 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404195600 0 0) 0x7f92800035b0 con 0x7f9298154b30 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 >> v2:172.21.15.104:3300/0 conn(0x7f92980ce5e0 msgr2=0x7f92980cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 --2- 172.21.15.26:0/4163470234 >> v2:172.21.15.104:3300/0 conn(0x7f92980ce5e0 0x7f92980cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 >> v1:172.21.15.104:6789/0 conn(0x7f92980cdaa0 legacy=0x7f92980b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980cb1e0 con 0x7f9298154b30 2023-06-09T04:38:43.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f928c001670 con 0x7f9298154b30 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 --2- 172.21.15.26:0/4163470234 >> v2:172.21.15.104:3300/0 conn(0x7f92980ce5e0 0x7f92980cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 >> v1:172.21.15.26:6789/0 conn(0x7f9298154b30 legacy=0x7f92980cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280003be0 0x7f9280003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9280004850 0x7f9280004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92800052c0 0x7f928000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980cb5c0 con 0x7f9280004850 2023-06-09T04:38:43.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928000c200 con 0x7f92800052c0 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928000c3c0 con 0x7f9280003be0 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9280004850 0x7f9280004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92977fe700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92800052c0 0x7f928000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f9296ffd700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280003be0 0x7f9280003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 -- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280003be0 msgr2=0x7f9280003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280003be0 0x7f9280003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 -- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92800052c0 msgr2=0x7f928000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92800052c0 0x7f928000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 -- 172.21.15.26:0/4163470234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800035b0 con 0x7f9280004850 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92977fe700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92800052c0 0x7f928000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92977fe700 1 -- 172.21.15.26:0/4163470234 reap_dead start 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.752+0000 7f92967fc700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9280004850 0x7f9280004cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9288009d30 tx=0x7f9280005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e223bd75a85456a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288009e80 con 0x7f9280004850 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800e9a0 con 0x7f9280004850 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f9295ffb700 1 -- 172.21.15.26:0/4163470234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800ed10 con 0x7f9280004850 2023-06-09T04:38:43.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 -- 172.21.15.26:0/4163470234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9280004850 msgr2=0x7f9280004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9280004850 0x7f9280004cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9288009d30 tx=0x7f9280005880 comp rx=0 tx=0).stop 2023-06-09T04:38:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 -- 172.21.15.26:0/4163470234 shutdown_connections 2023-06-09T04:38:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 --2- 172.21.15.26:0/4163470234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9280004850 0x7f9280004cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 -- 172.21.15.26:0/4163470234 >> 172.21.15.26:0/4163470234 conn(0x7f929806e560 msgr2=0x7f929806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 -- 172.21.15.26:0/4163470234 shutdown_connections 2023-06-09T04:38:43.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.753+0000 7f929d262700 1 -- 172.21.15.26:0/4163470234 wait complete. 2023-06-09T04:38:43.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.754+0000 7f929d262700 1 Processor -- start 2023-06-09T04:38:43.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 -- start start 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280004850 0x7f92980ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92980c6b80 0x7f92981eec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 0x7f92981ef190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980caa10 con 0x7f92980c6ff0 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298144520 con 0x7f92980c6b80 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f929d262700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9298144800 con 0x7f9280004850 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f92977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 0x7f92981ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f92977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 0x7f92981ef190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38684/0 (socket says 172.21.15.26:38684) 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.755+0000 7f92977fe700 1 -- 172.21.15.26:0/2140394909 learned_addr learned my addr 172.21.15.26:0/2140394909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92977fe700 1 -- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280004850 msgr2=0x7f92980ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f9296ffd700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280004850 0x7f92980ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92967fc700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92980c6b80 0x7f92981eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92977fe700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280004850 0x7f92980ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92977fe700 1 -- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92980c6b80 msgr2=0x7f92981eec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92977fe700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92980c6b80 0x7f92981eec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92977fe700 1 -- 172.21.15.26:0/2140394909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298144ae0 con 0x7f92980c6ff0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f92977fe700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 0x7f92981ef190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92980afdc0 tx=0x7f929000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290003c10 con 0x7f92980c6ff0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290003d90 con 0x7f92980c6ff0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000c930 con 0x7f92980c6ff0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9298144dc0 con 0x7f92980c6ff0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.756+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929815c3e0 con 0x7f92980c6ff0 2023-06-09T04:38:43.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.757+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298074080 con 0x7f92980c6ff0 2023-06-09T04:38:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.757+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f929000ca90 con 0x7f92980c6ff0 2023-06-09T04:38:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.758+0000 7f927f7fe700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f928406ace0 0x7f928406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.758+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9290089620 con 0x7f92980c6ff0 2023-06-09T04:38:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.758+0000 7f9296ffd700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f928406ace0 0x7f928406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.758+0000 7f9296ffd700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f928406ace0 0x7f928406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f928c001650 tx=0x7f928c000f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.762+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92900546d0 con 0x7f92980c6ff0 2023-06-09T04:38:43.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.959+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9298144f50 con 0x7f92980c6ff0 2023-06-09T04:38:43.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.960+0000 7f927f7fe700 1 -- 172.21.15.26:0/2140394909 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9290057cf0 con 0x7f92980c6ff0 2023-06-09T04:38:43.961 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:43.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.961+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f928406ace0 msgr2=0x7f928406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.961+0000 7f929d262700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f928406ace0 0x7f928406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f928c001650 tx=0x7f928c000f30 comp rx=0 tx=0).stop 2023-06-09T04:38:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.961+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 msgr2=0x7f92981ef190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.961+0000 7f929d262700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 0x7f92981ef190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92980afdc0 tx=0x7f929000ef40 comp rx=0 tx=0).stop 2023-06-09T04:38:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 shutdown_connections 2023-06-09T04:38:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f928406ace0 0x7f928406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92980c6ff0 0x7f92981ef190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9280004850 0x7f92980ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 --2- 172.21.15.26:0/2140394909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92980c6b80 0x7f92981eec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 >> 172.21.15.26:0/2140394909 conn(0x7f929806e560 msgr2=0x7f92980c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 shutdown_connections 2023-06-09T04:38:43.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:43.962+0000 7f929d262700 1 -- 172.21.15.26:0/2140394909 wait complete. 2023-06-09T04:38:43.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:44.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.100+0000 7f06fec0f700 1 Processor -- start 2023-06-09T04:38:44.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.100+0000 7f06fec0f700 1 -- start start 2023-06-09T04:38:44.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06fec0f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06f815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06fec0f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f806e100 con 0x7f06f806b1a0 2023-06-09T04:38:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06fec0f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f806e3e0 con 0x7f06f80710d0 2023-06-09T04:38:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06fec0f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f815dd10 con 0x7f06f815a380 2023-06-09T04:38:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06f7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f06f806b1a0 0x7f06f80709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47546/0 (socket says 172.21.15.26:47546) 2023-06-09T04:38:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06f7fff700 1 -- 172.21.15.26:0/3798806491 learned_addr learned my addr 172.21.15.26:0/3798806491 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:44.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06f815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582082576 0 0) 0x7f06f806e100 con 0x7f06f806b1a0 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.101+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e80035b0 con 0x7f06f806b1a0 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232157001 0 0) 0x7f06f806e3e0 con 0x7f06f80710d0 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f806e100 con 0x7f06f80710d0 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134825396 0 0) 0x7f06e80035b0 con 0x7f06f806b1a0 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 msgr2=0x7f06f815e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06f815e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 >> v1:172.21.15.104:6789/0 conn(0x7f06f80710d0 legacy=0x7f06f8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f815dff0 con 0x7f06f806b1a0 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f06e4001670 con 0x7f06f806b1a0 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06f815e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 >> v1:172.21.15.26:6789/0 conn(0x7f06f806b1a0 legacy=0x7f06f80709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06e8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e8004100 0x7f06e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8004d90 0x7f06e8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f815dd10 con 0x7f06e8004d90 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e800bb50 con 0x7f06e8004100 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e800bd10 con 0x7f06f815a380 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8004d90 0x7f06e8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06f7fff700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e8004100 0x7f06e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06e8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 -- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 msgr2=0x7f06e8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06f815a380 0x7f06e8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 -- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e8004100 msgr2=0x7f06e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e8004100 0x7f06e8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 -- 172.21.15.26:0/3798806491 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0094a0 con 0x7f06e8004d90 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.102+0000 7f06fd1ac700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8004d90 0x7f06e8005200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06f80714c0 tx=0x7f06e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d10fb41577cedf7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0003a00 con 0x7f06e8004d90 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0003b80 con 0x7f06e8004d90 2023-06-09T04:38:44.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06f77fe700 1 -- 172.21.15.26:0/3798806491 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00050d0 con 0x7f06e8004d90 2023-06-09T04:38:44.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fec0f700 1 -- 172.21.15.26:0/3798806491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8004d90 msgr2=0x7f06e8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fec0f700 1 --2- 172.21.15.26:0/3798806491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8004d90 0x7f06e8005200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06f80714c0 tx=0x7f06e8005880 comp rx=0 tx=0).stop 2023-06-09T04:38:44.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fd1ac700 1 -- 172.21.15.26:0/3798806491 reap_dead start 2023-06-09T04:38:44.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fec0f700 1 -- 172.21.15.26:0/3798806491 shutdown_connections 2023-06-09T04:38:44.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fec0f700 1 -- 172.21.15.26:0/3798806491 >> 172.21.15.26:0/3798806491 conn(0x7f06f80cb9d0 msgr2=0x7f06f80cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fec0f700 1 -- 172.21.15.26:0/3798806491 shutdown_connections 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.103+0000 7f06fec0f700 1 -- 172.21.15.26:0/3798806491 wait complete. 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.105+0000 7f06fec0f700 1 Processor -- start 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.105+0000 7f06fec0f700 1 -- start start 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fec0f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06e8004d90 0x7f06f81523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fec0f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 0x7f06f80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fec0f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80c4de0 0x7f06f80c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fec0f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80c5790 con 0x7f06f80c2a60 2023-06-09T04:38:44.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fec0f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80c35b0 con 0x7f06f80c4de0 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fec0f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80c3890 con 0x7f06e8004d90 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 0x7f06f80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 0x7f06f80c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38698/0 (socket says 172.21.15.26:38698) 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 -- 172.21.15.26:0/1071494347 learned_addr learned my addr 172.21.15.26:0/1071494347 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06e8004d90 0x7f06f81523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fd1ac700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80c4de0 0x7f06f80c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 -- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06e8004d90 msgr2=0x7f06f81523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06e8004d90 0x7f06f81523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 -- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80c4de0 msgr2=0x7f06f80c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80c4de0 0x7f06f80c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06f7fff700 1 -- 172.21.15.26:0/1071494347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80c3b70 con 0x7f06f80c2a60 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.106+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06e8004d90 0x7f06f81523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.107+0000 7f06f7fff700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 0x7f06f80c2ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06e4007310 tx=0x7f06e4007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.107+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011580 con 0x7f06f80c2a60 2023-06-09T04:38:44.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.107+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4011720 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.107+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80c3e50 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.107+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011ad0 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.107+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f80b4c20 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.108+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f815e2b0 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.108+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06e4011c30 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.109+0000 7f06f57fa700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.109+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06e4089270 con 0x7f06f80c2a60 2023-06-09T04:38:44.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.109+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.109+0000 7f06fc9ab700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06dc06ace0 0x7f06dc06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0145a0 tx=0x7f06ec009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.113+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06f815e2b0 con 0x7f06f80c2a60 2023-06-09T04:38:44.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.312+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06f80c4370 con 0x7f06f80c2a60 2023-06-09T04:38:44.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.313+0000 7f06f57fa700 1 -- 172.21.15.26:0/1071494347 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06f80c4370 con 0x7f06f80c2a60 2023-06-09T04:38:44.314 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06dc06ace0 msgr2=0x7f06dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06dc06ace0 0x7f06dc06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0145a0 tx=0x7f06ec009210 comp rx=0 tx=0).stop 2023-06-09T04:38:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 msgr2=0x7f06f80c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 0x7f06f80c2ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06e4007310 tx=0x7f06e4007620 comp rx=0 tx=0).stop 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 shutdown_connections 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80c4de0 0x7f06f80c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f06e8004d90 0x7f06f81523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 --2- 172.21.15.26:0/1071494347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06f80c2a60 0x7f06f80c2ed0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 >> 172.21.15.26:0/1071494347 conn(0x7f06f80cb9d0 msgr2=0x7f06f815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 shutdown_connections 2023-06-09T04:38:44.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.315+0000 7f06fec0f700 1 -- 172.21.15.26:0/1071494347 wait complete. 2023-06-09T04:38:44.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.451+0000 7f79f35ed700 1 Processor -- start 2023-06-09T04:38:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.451+0000 7f79f35ed700 1 -- start start 2023-06-09T04:38:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f35ed700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79ec069db0 0x7f79ec0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f35ed700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec0ae920 0x7f79ec06a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f35ed700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f79ec15ff50 0x7f79ec1603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f35ed700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec0ca670 con 0x7f79ec069db0 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f35ed700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec0aed70 con 0x7f79ec15ff50 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f35ed700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec06a6c0 con 0x7f79ec0ae920 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f1389700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79ec069db0 0x7f79ec0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f1389700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f79ec069db0 0x7f79ec0cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38704/0 (socket says 172.21.15.26:38704) 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.452+0000 7f79f1389700 1 -- 172.21.15.26:0/1921496563 learned_addr learned my addr 172.21.15.26:0/1921496563 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1b8a700 1 --2- 172.21.15.26:0/1921496563 >> v2:172.21.15.104:3300/0 conn(0x7f79ec15ff50 0x7f79ec1603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f0b88700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec0ae920 0x7f79ec06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1389700 1 -- 172.21.15.26:0/1921496563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec0ae920 msgr2=0x7f79ec06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1389700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec0ae920 0x7f79ec06a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1389700 1 -- 172.21.15.26:0/1921496563 >> v2:172.21.15.104:3300/0 conn(0x7f79ec15ff50 msgr2=0x7f79ec1603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1389700 1 --2- 172.21.15.26:0/1921496563 >> v2:172.21.15.104:3300/0 conn(0x7f79ec15ff50 0x7f79ec1603d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1389700 1 -- 172.21.15.26:0/1921496563 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec0ce380 con 0x7f79ec069db0 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f0b88700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec0ae920 0x7f79ec06a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1b8a700 1 --2- 172.21.15.26:0/1921496563 >> v2:172.21.15.104:3300/0 conn(0x7f79ec15ff50 0x7f79ec1603d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79f1389700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec069db0 0x7f79ec0cdda0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c9da0 tx=0x7f79dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cba2b64323e561 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79e3fff700 1 -- 172.21.15.26:0/1921496563 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc005e30 con 0x7f79ec069db0 2023-06-09T04:38:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79e3fff700 1 -- 172.21.15.26:0/1921496563 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc004030 con 0x7f79ec069db0 2023-06-09T04:38:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.453+0000 7f79e3fff700 1 -- 172.21.15.26:0/1921496563 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0043e0 con 0x7f79ec069db0 2023-06-09T04:38:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 -- 172.21.15.26:0/1921496563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec069db0 msgr2=0x7f79ec0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec069db0 0x7f79ec0cdda0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c9da0 tx=0x7f79dc009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 -- 172.21.15.26:0/1921496563 shutdown_connections 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 --2- 172.21.15.26:0/1921496563 >> v2:172.21.15.104:3300/0 conn(0x7f79ec15ff50 0x7f79ec1603d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec069db0 0x7f79ec0cdda0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 --2- 172.21.15.26:0/1921496563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec0ae920 0x7f79ec06a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 -- 172.21.15.26:0/1921496563 >> 172.21.15.26:0/1921496563 conn(0x7f79ec098b50 msgr2=0x7f79ec0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 -- 172.21.15.26:0/1921496563 shutdown_connections 2023-06-09T04:38:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.454+0000 7f79f35ed700 1 -- 172.21.15.26:0/1921496563 wait complete. 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.455+0000 7f79f35ed700 1 Processor -- start 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.455+0000 7f79f35ed700 1 -- start start 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f35ed700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec069db0 0x7f79ec0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f35ed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 0x7f79ec0b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f35ed700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79ec15ff50 0x7f79ec0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f35ed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b4470 con 0x7f79ec0ae920 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f35ed700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b4750 con 0x7f79ec15ff50 2023-06-09T04:38:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f35ed700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b4a30 con 0x7f79ec069db0 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 0x7f79ec0b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 0x7f79ec0b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38712/0 (socket says 172.21.15.26:38712) 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 -- 172.21.15.26:0/104436492 learned_addr learned my addr 172.21.15.26:0/104436492 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f1389700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec069db0 0x7f79ec0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f1b8a700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79ec15ff50 0x7f79ec0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 -- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec069db0 msgr2=0x7f79ec0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec069db0 0x7f79ec0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 -- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79ec15ff50 msgr2=0x7f79ec0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79ec15ff50 0x7f79ec0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 -- 172.21.15.26:0/104436492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009500 con 0x7f79ec0ae920 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.456+0000 7f79f0b88700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 0x7f79ec0b25f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79e800d800 tx=0x7f79e800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.457+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8004030 con 0x7f79ec0ae920 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.457+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8004190 con 0x7f79ec0ae920 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.457+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec0b4d10 con 0x7f79ec0ae920 2023-06-09T04:38:44.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.457+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8004520 con 0x7f79ec0ae920 2023-06-09T04:38:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.457+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec14a6d0 con 0x7f79ec0ae920 2023-06-09T04:38:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.458+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec0b5230 con 0x7f79ec0ae920 2023-06-09T04:38:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.458+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79e80036a0 con 0x7f79ec0ae920 2023-06-09T04:38:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.459+0000 7f79e1ffb700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f79d006ace0 0x7f79d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.459+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79e80899f0 con 0x7f79ec0ae920 2023-06-09T04:38:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.459+0000 7f79f1389700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f79d006ace0 0x7f79d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.459+0000 7f79f1389700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f79d006ace0 0x7f79d006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c9da0 tx=0x7f79dc008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.463+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79ec0b5230 con 0x7f79ec0ae920 2023-06-09T04:38:44.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.661+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79ec0b5230 con 0x7f79ec0ae920 2023-06-09T04:38:44.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.662+0000 7f79e1ffb700 1 -- 172.21.15.26:0/104436492 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f79ec0b5230 con 0x7f79ec0ae920 2023-06-09T04:38:44.664 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:44.664 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f79d006ace0 msgr2=0x7f79d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f79d006ace0 0x7f79d006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c9da0 tx=0x7f79dc008070 comp rx=0 tx=0).stop 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 msgr2=0x7f79ec0b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 0x7f79ec0b25f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79e800d800 tx=0x7f79e800dbc0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 shutdown_connections 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79ec15ff50 0x7f79ec0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79ec069db0 0x7f79ec0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f79d006ace0 0x7f79d006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 --2- 172.21.15.26:0/104436492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79ec0ae920 0x7f79ec0b25f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 >> 172.21.15.26:0/104436492 conn(0x7f79ec098b50 msgr2=0x7f79ec0adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 shutdown_connections 2023-06-09T04:38:44.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.664+0000 7f79f35ed700 1 -- 172.21.15.26:0/104436492 wait complete. 2023-06-09T04:38:44.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:44.679 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.806+0000 7fe562b8f700 1 Processor -- start 2023-06-09T04:38:44.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.806+0000 7fe562b8f700 1 -- start start 2023-06-09T04:38:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe562b8f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe55c0b0850 0x7fe55c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe562b8f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0d08b0 con 0x7fe55c15a340 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe562b8f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0b0d20 con 0x7fe55c0cebc0 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe562b8f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c15a710 con 0x7fe55c0b0850 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe56092b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe55c15a340 0x7fe55c0ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47576/0 (socket says 172.21.15.26:47576) 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe56092b700 1 -- 172.21.15.26:0/379310737 learned_addr learned my addr 172.21.15.26:0/379310737 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503733784 0 0) 0x7fe55c0d08b0 con 0x7fe55c15a340 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe54c0035b0 con 0x7fe55c15a340 2023-06-09T04:38:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe56112c700 1 --2- 172.21.15.26:0/379310737 >> v2:172.21.15.104:3300/0 conn(0x7fe55c0b0850 0x7fe55c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827454079 0 0) 0x7fe54c0035b0 con 0x7fe55c15a340 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 >> v2:172.21.15.104:3300/0 conn(0x7fe55c0b0850 msgr2=0x7fe55c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 --2- 172.21.15.26:0/379310737 >> v2:172.21.15.104:3300/0 conn(0x7fe55c0b0850 0x7fe55c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 >> v1:172.21.15.104:6789/0 conn(0x7fe55c0cebc0 legacy=0x7fe55c0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0b1000 con 0x7fe55c15a340 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fe5500017f0 con 0x7fe55c15a340 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 >> v1:172.21.15.26:6789/0 conn(0x7fe55c15a340 legacy=0x7fe55c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c003a00 0x7fe54c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe54c004850 0x7fe54c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe54c005200 0x7fe54c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c15a710 con 0x7fe54c005200 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c00c0e0 con 0x7fe54c003a00 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.807+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c00c2a0 con 0x7fe54c004850 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe54c005200 0x7fe54c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56092b700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c003a00 0x7fe54c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe55bfff700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe54c004850 0x7fe54c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 -- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe54c004850 msgr2=0x7fe54c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe54c004850 0x7fe54c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 -- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c003a00 msgr2=0x7fe54c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c003a00 0x7fe54c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 -- 172.21.15.26:0/379310737 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0035b0 con 0x7fe54c005200 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 -- 172.21.15.26:0/379310737 reap_dead start 2023-06-09T04:38:44.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe56112c700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe54c005200 0x7fe54c00ba10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0b0c50 tx=0x7fe54c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefe18399bdb2dcf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554007e20 con 0x7fe54c005200 2023-06-09T04:38:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554003a20 con 0x7fe54c005200 2023-06-09T04:38:44.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.808+0000 7fe55b7fe700 1 -- 172.21.15.26:0/379310737 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554003dd0 con 0x7fe54c005200 2023-06-09T04:38:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 -- 172.21.15.26:0/379310737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe54c005200 msgr2=0x7fe54c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe54c005200 0x7fe54c00ba10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0b0c50 tx=0x7fe54c005880 comp rx=0 tx=0).stop 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 -- 172.21.15.26:0/379310737 shutdown_connections 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 --2- 172.21.15.26:0/379310737 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe54c005200 0x7fe54c00ba10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 -- 172.21.15.26:0/379310737 >> 172.21.15.26:0/379310737 conn(0x7fe55c089fc0 msgr2=0x7fe55c08a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 -- 172.21.15.26:0/379310737 shutdown_connections 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.809+0000 7fe562b8f700 1 -- 172.21.15.26:0/379310737 wait complete. 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.810+0000 7fe562b8f700 1 Processor -- start 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.811+0000 7fe562b8f700 1 -- start start 2023-06-09T04:38:44.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c005200 0x7fe55c14e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe55c1544c0 0x7fe55c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 0x7fe55c1df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c154e70 con 0x7fe55c1df560 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b3820 con 0x7fe54c005200 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1e0200 con 0x7fe55c1544c0 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 0x7fe55c1df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 0x7fe55c1df9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38734/0 (socket says 172.21.15.26:38734) 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 -- 172.21.15.26:0/4052978508 learned_addr learned my addr 172.21.15.26:0/4052978508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56092b700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c005200 0x7fe55c14e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe55bfff700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe55c1544c0 0x7fe55c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 -- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe55c1544c0 msgr2=0x7fe55c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe55c1544c0 0x7fe55c154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 -- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c005200 msgr2=0x7fe55c14e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c005200 0x7fe55c14e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 -- 172.21.15.26:0/4052978508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c1e04e0 con 0x7fe55c1df560 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56092b700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c005200 0x7fe55c14e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe56112c700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 0x7fe55c1df9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0b6960 tx=0x7fe554004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554004530 con 0x7fe55c1df560 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540046b0 con 0x7fe55c1df560 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c1e07c0 con 0x7fe55c1df560 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554020470 con 0x7fe55c1df560 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.812+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c1e0d80 con 0x7fe55c1df560 2023-06-09T04:38:44.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.813+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c1e15f0 con 0x7fe55c1df560 2023-06-09T04:38:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.814+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5540205d0 con 0x7fe55c1df560 2023-06-09T04:38:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.814+0000 7fe5597fa700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe54006ace0 0x7fe54006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.814+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe55408b0e0 con 0x7fe55c1df560 2023-06-09T04:38:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.814+0000 7fe56092b700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe54006ace0 0x7fe54006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.815+0000 7fe56092b700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe54006ace0 0x7fe54006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe550000c00 tx=0x7fe550009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:44.819+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe554056340 con 0x7fe55c1df560 2023-06-09T04:38:45.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.014+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe55c155a60 con 0x7fe55c1df560 2023-06-09T04:38:45.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.014+0000 7fe5597fa700 1 -- 172.21.15.26:0/4052978508 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe554059960 con 0x7fe55c1df560 2023-06-09T04:38:45.015 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:45.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe54006ace0 msgr2=0x7fe54006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe54006ace0 0x7fe54006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe550000c00 tx=0x7fe550009040 comp rx=0 tx=0).stop 2023-06-09T04:38:45.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 msgr2=0x7fe55c1df9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 0x7fe55c1df9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0b6960 tx=0x7fe554004b40 comp rx=0 tx=0).stop 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 shutdown_connections 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe54006ace0 0x7fe54006d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe55c1df560 0x7fe55c1df9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54c005200 0x7fe55c14e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 --2- 172.21.15.26:0/4052978508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe55c1544c0 0x7fe55c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 >> 172.21.15.26:0/4052978508 conn(0x7fe55c089fc0 msgr2=0x7fe55c0af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 shutdown_connections 2023-06-09T04:38:45.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.016+0000 7fe562b8f700 1 -- 172.21.15.26:0/4052978508 wait complete. 2023-06-09T04:38:45.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:45.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.157+0000 7feadc022700 1 Processor -- start 2023-06-09T04:38:45.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.157+0000 7feadc022700 1 -- start start 2023-06-09T04:38:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feadc022700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fead415c6e0 0x7fead40ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feadc022700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead406e990 0x7fead40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feadc022700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead406f190 con 0x7fead4098e30 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feadc022700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead406e440 con 0x7fead415c6e0 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feadc022700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead406e690 con 0x7fead406e990 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feada5bf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fead4098e30 0x7fead40cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47600/0 (socket says 172.21.15.26:47600) 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7feada5bf700 1 -- 172.21.15.26:0/686450194 learned_addr learned my addr 172.21.15.26:0/686450194 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7fead9dbe700 1 --2- 172.21.15.26:0/686450194 >> v2:172.21.15.104:3300/0 conn(0x7fead415c6e0 0x7fead40ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.158+0000 7fead95bd700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead406e990 0x7fead40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead8dbc700 1 -- 172.21.15.26:0/686450194 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979812309 0 0) 0x7fead406f190 con 0x7fead4098e30 2023-06-09T04:38:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead8dbc700 1 -- 172.21.15.26:0/686450194 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac00035b0 con 0x7fead4098e30 2023-06-09T04:38:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead9dbe700 1 -- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead406e990 msgr2=0x7fead40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead9dbe700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead406e990 0x7fead40aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead9dbe700 1 -- 172.21.15.26:0/686450194 >> v1:172.21.15.26:6789/0 conn(0x7fead4098e30 legacy=0x7fead40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead9dbe700 1 -- 172.21.15.26:0/686450194 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4160300 con 0x7fead415c6e0 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead95bd700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead406e990 0x7fead40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead9dbe700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead415c6e0 0x7fead40ae640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feac4009820 tx=0x7feac4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6696b42ac601943 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead8dbc700 1 -- 172.21.15.26:0/686450194 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4005e30 con 0x7fead415c6e0 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead8dbc700 1 -- 172.21.15.26:0/686450194 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4006030 con 0x7fead415c6e0 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.159+0000 7fead8dbc700 1 -- 172.21.15.26:0/686450194 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40063c0 con 0x7fead415c6e0 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 -- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead415c6e0 msgr2=0x7fead40ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead415c6e0 0x7fead40ae640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feac4009820 tx=0x7feac4009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:45.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 -- 172.21.15.26:0/686450194 shutdown_connections 2023-06-09T04:38:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead415c6e0 0x7fead40ae640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 --2- 172.21.15.26:0/686450194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead406e990 0x7fead40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 -- 172.21.15.26:0/686450194 >> 172.21.15.26:0/686450194 conn(0x7fead4098a30 msgr2=0x7fead40cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 -- 172.21.15.26:0/686450194 shutdown_connections 2023-06-09T04:38:45.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.160+0000 7feadc022700 1 -- 172.21.15.26:0/686450194 wait complete. 2023-06-09T04:38:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.161+0000 7feadc022700 1 Processor -- start 2023-06-09T04:38:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 -- start start 2023-06-09T04:38:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead406e990 0x7fead41f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 0x7fead40c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead415c6e0 0x7fead41f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c5280 con 0x7fead4098e30 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c6220 con 0x7fead406e990 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.162+0000 7feadc022700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c5f40 con 0x7fead415c6e0 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 0x7fead40c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 0x7fead40c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38746/0 (socket says 172.21.15.26:38746) 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 -- 172.21.15.26:0/3034164933 learned_addr learned my addr 172.21.15.26:0/3034164933 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead9dbe700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead406e990 0x7fead41f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7feada5bf700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead415c6e0 0x7fead41f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 -- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead415c6e0 msgr2=0x7fead41f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead415c6e0 0x7fead41f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 -- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead406e990 msgr2=0x7fead41f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead406e990 0x7fead41f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 -- 172.21.15.26:0/3034164933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00094a0 con 0x7fead4098e30 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7fead95bd700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 0x7fead40c4d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fead000ebe0 tx=0x7fead0009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000c8b0 con 0x7fead4098e30 2023-06-09T04:38:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000ca10 con 0x7fead4098e30 2023-06-09T04:38:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac4009430 con 0x7fead4098e30 2023-06-09T04:38:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000cda0 con 0x7fead4098e30 2023-06-09T04:38:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.163+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead41f23f0 con 0x7fead4098e30 2023-06-09T04:38:45.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.164+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead40ca980 con 0x7fead4098e30 2023-06-09T04:38:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.165+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fead0013470 con 0x7fead4098e30 2023-06-09T04:38:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.166+0000 7feaca7fc700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feab806ace0 0x7feab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.166+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fead0089c40 con 0x7fead4098e30 2023-06-09T04:38:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.166+0000 7fead9dbe700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feab806ace0 0x7feab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.166+0000 7fead9dbe700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feab806ace0 0x7feab806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feac4009b70 tx=0x7feac4008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.169+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fead0054e60 con 0x7fead4098e30 2023-06-09T04:38:45.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.364+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fead4067180 con 0x7fead4098e30 2023-06-09T04:38:45.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.365+0000 7feaca7fc700 1 -- 172.21.15.26:0/3034164933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fead00210a0 con 0x7fead4098e30 2023-06-09T04:38:45.366 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feab806ace0 msgr2=0x7feab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feab806ace0 0x7feab806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feac4009b70 tx=0x7feac4008070 comp rx=0 tx=0).stop 2023-06-09T04:38:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 msgr2=0x7fead40c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 0x7fead40c4d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fead000ebe0 tx=0x7fead0009e20 comp rx=0 tx=0).stop 2023-06-09T04:38:45.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 shutdown_connections 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fead415c6e0 0x7fead41f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fead406e990 0x7fead41f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7feab806ace0 0x7feab806d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 --2- 172.21.15.26:0/3034164933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4098e30 0x7fead40c4d40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 >> 172.21.15.26:0/3034164933 conn(0x7fead4098a30 msgr2=0x7fead40ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 shutdown_connections 2023-06-09T04:38:45.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.367+0000 7feadc022700 1 -- 172.21.15.26:0/3034164933 wait complete. 2023-06-09T04:38:45.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:45.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.506+0000 7f04da7ce700 1 Processor -- start 2023-06-09T04:38:45.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04da7ce700 1 -- start start 2023-06-09T04:38:45.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04da7ce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f04d40b0850 0x7f04d40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04da7ce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d40d08b0 con 0x7f04d40cebc0 2023-06-09T04:38:45.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04da7ce700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d40b0d20 con 0x7f04d415a340 2023-06-09T04:38:45.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04da7ce700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d415a710 con 0x7f04d40b0850 2023-06-09T04:38:45.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04d8d6b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f04d40b0850 0x7f04d40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04d37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f04d40cebc0 0x7f04d40b0140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47610/0 (socket says 172.21.15.26:47610) 2023-06-09T04:38:45.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.507+0000 7f04d37fe700 1 -- 172.21.15.26:0/2529285439 learned_addr learned my addr 172.21.15.26:0/2529285439 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:45.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d8d6b700 1 -- 172.21.15.26:0/2529285439 >> v1:172.21.15.104:6789/0 conn(0x7f04d415a340 legacy=0x7f04d40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d8d6b700 1 -- 172.21.15.26:0/2529285439 >> v1:172.21.15.26:6789/0 conn(0x7f04d40cebc0 legacy=0x7f04d40b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d8d6b700 1 -- 172.21.15.26:0/2529285439 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40b1000 con 0x7f04d40b0850 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d2ffd700 1 -- 172.21.15.26:0/2529285439 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059069496 0 0) 0x7f04d40d08b0 con 0x7f04d40cebc0 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d8d6b700 1 --2- 172.21.15.26:0/2529285439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d40b0850 0x7f04d40b1dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d90 tx=0x7f04cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c933235b53f9b94 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d2ffd700 1 -- 172.21.15.26:0/2529285439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00e070 con 0x7f04d40b0850 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d2ffd700 1 -- 172.21.15.26:0/2529285439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00bbd0 con 0x7f04d40b0850 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.508+0000 7f04d2ffd700 1 -- 172.21.15.26:0/2529285439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc012430 con 0x7f04d40b0850 2023-06-09T04:38:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 -- 172.21.15.26:0/2529285439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d40b0850 msgr2=0x7f04d40b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 --2- 172.21.15.26:0/2529285439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d40b0850 0x7f04d40b1dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d90 tx=0x7f04cc00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:45.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 -- 172.21.15.26:0/2529285439 shutdown_connections 2023-06-09T04:38:45.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 --2- 172.21.15.26:0/2529285439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d40b0850 0x7f04d40b1dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 -- 172.21.15.26:0/2529285439 >> 172.21.15.26:0/2529285439 conn(0x7f04d4089fc0 msgr2=0x7f04d408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 -- 172.21.15.26:0/2529285439 shutdown_connections 2023-06-09T04:38:45.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.509+0000 7f04da7ce700 1 -- 172.21.15.26:0/2529285439 wait complete. 2023-06-09T04:38:45.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.510+0000 7f04da7ce700 1 Processor -- start 2023-06-09T04:38:45.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.510+0000 7f04da7ce700 1 -- start start 2023-06-09T04:38:45.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04da7ce700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04d40b0850 0x7f04d40ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04da7ce700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d40cebc0 0x7f04d406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04da7ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 0x7f04d41e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04da7ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40af680 con 0x7f04d415a340 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04da7ce700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40ae7f0 con 0x7f04d40cebc0 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04da7ce700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d406cc30 con 0x7f04d40b0850 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 0x7f04d41e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 0x7f04d41e3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38762/0 (socket says 172.21.15.26:38762) 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 -- 172.21.15.26:0/3178977059 learned_addr learned my addr 172.21.15.26:0/3178977059 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d37fe700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d40cebc0 0x7f04d406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d3fff700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04d40b0850 0x7f04d40ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 -- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04d40b0850 msgr2=0x7f04d40ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04d40b0850 0x7f04d40ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 -- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d40cebc0 msgr2=0x7f04d406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d40cebc0 0x7f04d406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.511+0000 7f04d8d6b700 1 -- 172.21.15.26:0/3178977059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc009a70 con 0x7f04d415a340 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.512+0000 7f04d8d6b700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 0x7f04d41e3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04cc013000 tx=0x7f04cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.512+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc01b810 con 0x7f04d415a340 2023-06-09T04:38:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.512+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc020070 con 0x7f04d415a340 2023-06-09T04:38:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.512+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc01bbd0 con 0x7f04d415a340 2023-06-09T04:38:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.512+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d40aea00 con 0x7f04d415a340 2023-06-09T04:38:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.512+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40af2a0 con 0x7f04d415a340 2023-06-09T04:38:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.513+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40aee20 con 0x7f04d415a340 2023-06-09T04:38:45.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.513+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04cc01bd30 con 0x7f04d415a340 2023-06-09T04:38:45.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.514+0000 7f04d0ff9700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04b406ace0 0x7f04b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.514+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04cc022070 con 0x7f04d415a340 2023-06-09T04:38:45.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.514+0000 7f04d3fff700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04b406ace0 0x7f04b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.514+0000 7f04d3fff700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04b406ace0 0x7f04b406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f04d40cce80 tx=0x7f04bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.518+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f04d40aee20 con 0x7f04d415a340 2023-06-09T04:38:45.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.712+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04d40aee20 con 0x7f04d415a340 2023-06-09T04:38:45.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.713+0000 7f04d0ff9700 1 -- 172.21.15.26:0/3178977059 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04d40aee20 con 0x7f04d415a340 2023-06-09T04:38:45.715 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:45.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04b406ace0 msgr2=0x7f04b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04b406ace0 0x7f04b406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f04d40cce80 tx=0x7f04bc009040 comp rx=0 tx=0).stop 2023-06-09T04:38:45.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 msgr2=0x7f04d41e3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 0x7f04d41e3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04cc013000 tx=0x7f04cc004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 shutdown_connections 2023-06-09T04:38:45.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04b406ace0 0x7f04b406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04d415a340 0x7f04d41e3a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04d40b0850 0x7f04d40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 --2- 172.21.15.26:0/3178977059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04d40cebc0 0x7f04d406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 >> 172.21.15.26:0/3178977059 conn(0x7f04d4089fc0 msgr2=0x7f04d41592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 shutdown_connections 2023-06-09T04:38:45.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.715+0000 7f04da7ce700 1 -- 172.21.15.26:0/3178977059 wait complete. 2023-06-09T04:38:45.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:45.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.853+0000 7f440ea86700 1 Processor -- start 2023-06-09T04:38:45.855 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.854+0000 7f440ea86700 1 -- start start 2023-06-09T04:38:45.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.854+0000 7f440ea86700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f440815d820 0x7f44080ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.854+0000 7f440ea86700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44080d0f80 0x7f44080ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.854+0000 7f440ea86700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44080ad470 con 0x7f44080b1b30 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.854+0000 7f440ea86700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080cf0e0 con 0x7f44080d0f80 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.854+0000 7f440ea86700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080adff0 con 0x7f440815d820 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44080d0f80 0x7f44080ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44080d0f80 0x7f44080ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38770/0 (socket says 172.21.15.26:38770) 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 -- 172.21.15.26:0/1892056564 learned_addr learned my addr 172.21.15.26:0/1892056564 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440c822700 1 --2- 172.21.15.26:0/1892056564 >> v2:172.21.15.104:3300/0 conn(0x7f440815d820 0x7f44080ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 -- 172.21.15.26:0/1892056564 >> v2:172.21.15.104:3300/0 conn(0x7f440815d820 msgr2=0x7f44080ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 --2- 172.21.15.26:0/1892056564 >> v2:172.21.15.104:3300/0 conn(0x7f440815d820 0x7f44080ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 -- 172.21.15.26:0/1892056564 >> v1:172.21.15.104:6789/0 conn(0x7f44080b1b30 legacy=0x7f44080d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 -- 172.21.15.26:0/1892056564 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080b3730 con 0x7f44080d0f80 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f440d023700 1 --2- 172.21.15.26:0/1892056564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080d0f80 0x7f44080ae480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f44080d0840 tx=0x7f440000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb92143f38c290b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f44077fe700 1 -- 172.21.15.26:0/1892056564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000e070 con 0x7f44080d0f80 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f44077fe700 1 -- 172.21.15.26:0/1892056564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000b9c0 con 0x7f44080d0f80 2023-06-09T04:38:45.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.855+0000 7f44077fe700 1 -- 172.21.15.26:0/1892056564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000bd70 con 0x7f44080d0f80 2023-06-09T04:38:45.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 -- 172.21.15.26:0/1892056564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080d0f80 msgr2=0x7f44080ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 --2- 172.21.15.26:0/1892056564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080d0f80 0x7f44080ae480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f44080d0840 tx=0x7f440000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 -- 172.21.15.26:0/1892056564 shutdown_connections 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 --2- 172.21.15.26:0/1892056564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080d0f80 0x7f44080ae480 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 --2- 172.21.15.26:0/1892056564 >> v2:172.21.15.104:3300/0 conn(0x7f440815d820 0x7f44080ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 -- 172.21.15.26:0/1892056564 >> 172.21.15.26:0/1892056564 conn(0x7f4408089fc0 msgr2=0x7f440808a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 -- 172.21.15.26:0/1892056564 shutdown_connections 2023-06-09T04:38:45.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.856+0000 7f440ea86700 1 -- 172.21.15.26:0/1892056564 wait complete. 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.857+0000 7f440ea86700 1 Processor -- start 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.857+0000 7f440ea86700 1 -- start start 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440ea86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 0x7f4408155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440ea86700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d0f80 0x7f44080cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440ea86700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f440815d820 0x7f44081ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440ea86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44081ef6f0 con 0x7f44080b1b30 2023-06-09T04:38:45.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440ea86700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4408156b20 con 0x7f44080d0f80 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440ea86700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4408156280 con 0x7f440815d820 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 0x7f4408155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 0x7f4408155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38772/0 (socket says 172.21.15.26:38772) 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 -- 172.21.15.26:0/731838733 learned_addr learned my addr 172.21.15.26:0/731838733 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f4407fff700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d0f80 0x7f44080cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440d023700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f440815d820 0x7f44081ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 -- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f440815d820 msgr2=0x7f44081ef1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f440815d820 0x7f44081ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 -- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d0f80 msgr2=0x7f44080cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d0f80 0x7f44080cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f440c822700 1 -- 172.21.15.26:0/731838733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400009b30 con 0x7f44080b1b30 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.858+0000 7f4407fff700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d0f80 0x7f44080cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.859+0000 7f440c822700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 0x7f4408155ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00e810 tx=0x7f43fc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.859+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc013610 con 0x7f44080b1b30 2023-06-09T04:38:45.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.859+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc013770 con 0x7f44080b1b30 2023-06-09T04:38:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.859+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc013b20 con 0x7f44080b1b30 2023-06-09T04:38:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.859+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4408156560 con 0x7f44080b1b30 2023-06-09T04:38:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.859+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44081f1db0 con 0x7f44080b1b30 2023-06-09T04:38:45.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.860+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44081f1be0 con 0x7f44080b1b30 2023-06-09T04:38:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.860+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43fc013c80 con 0x7f44080b1b30 2023-06-09T04:38:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.861+0000 7f44057fa700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f43ec06ace0 0x7f43ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.861+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43fc0891b0 con 0x7f44080b1b30 2023-06-09T04:38:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.861+0000 7f4407fff700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f43ec06ace0 0x7f43ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.861+0000 7f4407fff700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f43ec06ace0 0x7f43ec06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4408066580 tx=0x7f43f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:45.865+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43fc057cf0 con 0x7f44080b1b30 2023-06-09T04:38:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.061+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44080703e0 con 0x7f44080b1b30 2023-06-09T04:38:46.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.061+0000 7f44057fa700 1 -- 172.21.15.26:0/731838733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43fc057880 con 0x7f44080b1b30 2023-06-09T04:38:46.062 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:46.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f43ec06ace0 msgr2=0x7f43ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f43ec06ace0 0x7f43ec06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4408066580 tx=0x7f43f4009040 comp rx=0 tx=0).stop 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 msgr2=0x7f4408155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 0x7f4408155ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00e810 tx=0x7f43fc00ebd0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 shutdown_connections 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f440815d820 0x7f44081ef1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f43ec06ace0 0x7f43ec06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44080b1b30 0x7f4408155ca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 --2- 172.21.15.26:0/731838733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d0f80 0x7f44080cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 >> 172.21.15.26:0/731838733 conn(0x7f4408089fc0 msgr2=0x7f44080b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:46.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 shutdown_connections 2023-06-09T04:38:46.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.063+0000 7f440ea86700 1 -- 172.21.15.26:0/731838733 wait complete. 2023-06-09T04:38:46.085 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T04:38:46.086 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T04:38:46.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.211+0000 7f85fab15700 1 Processor -- start 2023-06-09T04:38:46.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.211+0000 7f85fab15700 1 -- start start 2023-06-09T04:38:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85fab15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85f40ca320 0x7f85f41595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85fab15700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f40ca790 con 0x7f85f41591d0 2023-06-09T04:38:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85fab15700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f40caa70 con 0x7f85f40cd530 2023-06-09T04:38:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85fab15700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f4159ae0 con 0x7f85f40ca320 2023-06-09T04:38:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f85f40ca320 0x7f85f41595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f88b1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85f41591d0 0x7f85f40c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47638/0 (socket says 172.21.15.26:47638) 2023-06-09T04:38:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f88b1700 1 -- 172.21.15.26:0/1053034656 learned_addr learned my addr 172.21.15.26:0/1053034656 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:46.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f3fff700 1 --2- 172.21.15.26:0/1053034656 >> v2:172.21.15.26:3300/0 conn(0x7f85f40ca320 0x7f85f41595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38782/0 (socket says 172.21.15.26:38782) 2023-06-09T04:38:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f3fff700 1 -- 172.21.15.26:0/1053034656 >> v1:172.21.15.104:6789/0 conn(0x7f85f40cd530 legacy=0x7f85f40cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f3fff700 1 -- 172.21.15.26:0/1053034656 >> v1:172.21.15.26:6789/0 conn(0x7f85f41591d0 legacy=0x7f85f40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f37fe700 1 -- 172.21.15.26:0/1053034656 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518498895 0 0) 0x7f85f40ca790 con 0x7f85f41591d0 2023-06-09T04:38:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f3fff700 1 -- 172.21.15.26:0/1053034656 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40cad50 con 0x7f85f40ca320 2023-06-09T04:38:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.212+0000 7f85f3fff700 1 --2- 172.21.15.26:0/1053034656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f41595a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009840 tx=0x7f85e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290638db0ae52daf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85f37fe700 1 -- 172.21.15.26:0/1053034656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004230 con 0x7f85f40ca320 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85f37fe700 1 -- 172.21.15.26:0/1053034656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0004390 con 0x7f85f40ca320 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85f37fe700 1 -- 172.21.15.26:0/1053034656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00036a0 con 0x7f85f40ca320 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 -- 172.21.15.26:0/1053034656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 msgr2=0x7f85f41595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 --2- 172.21.15.26:0/1053034656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f41595a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009840 tx=0x7f85e0009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 -- 172.21.15.26:0/1053034656 shutdown_connections 2023-06-09T04:38:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 --2- 172.21.15.26:0/1053034656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f41595a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 -- 172.21.15.26:0/1053034656 >> 172.21.15.26:0/1053034656 conn(0x7f85f40cb9d0 msgr2=0x7f85f40cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 -- 172.21.15.26:0/1053034656 shutdown_connections 2023-06-09T04:38:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.213+0000 7f85fab15700 1 -- 172.21.15.26:0/1053034656 wait complete. 2023-06-09T04:38:46.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.214+0000 7f85fab15700 1 Processor -- start 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.214+0000 7f85fab15700 1 -- start start 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85fab15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f40b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85fab15700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85f40cd530 0x7f85f415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85fab15700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f41591d0 0x7f85f414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85fab15700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40b2fe0 con 0x7f85f40ca320 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85fab15700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415da70 con 0x7f85f41591d0 2023-06-09T04:38:46.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85fab15700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415d310 con 0x7f85f40cd530 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85f88b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f40b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85f88b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f40b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38786/0 (socket says 172.21.15.26:38786) 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.215+0000 7f85f88b1700 1 -- 172.21.15.26:0/2711412895 learned_addr learned my addr 172.21.15.26:0/2711412895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f3fff700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85f40cd530 0x7f85f415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f90b2700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f41591d0 0x7f85f414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f88b1700 1 -- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85f40cd530 msgr2=0x7f85f415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f88b1700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85f40cd530 0x7f85f415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f88b1700 1 -- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f41591d0 msgr2=0x7f85f414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f88b1700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f41591d0 0x7f85f414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f88b1700 1 -- 172.21.15.26:0/2711412895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00094a0 con 0x7f85f40ca320 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f88b1700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f40b1d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85e800c580 tx=0x7f85e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8004c80 con 0x7f85f40ca320 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e8004e00 con 0x7f85f40ca320 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f40b2360 con 0x7f85f40ca320 2023-06-09T04:38:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8007310 con 0x7f85f40ca320 2023-06-09T04:38:46.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.216+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f40b2920 con 0x7f85f40ca320 2023-06-09T04:38:46.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.217+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f40b3120 con 0x7f85f40ca320 2023-06-09T04:38:46.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.217+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85e8007470 con 0x7f85f40ca320 2023-06-09T04:38:46.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.218+0000 7f85f17fa700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85d806ace0 0x7f85d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.218+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85e80890d0 con 0x7f85f40ca320 2023-06-09T04:38:46.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.218+0000 7f85f3fff700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85d806ace0 0x7f85d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.219+0000 7f85f3fff700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85d806ace0 0x7f85d806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:46.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.222+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85f40b3120 con 0x7f85f40ca320 2023-06-09T04:38:46.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:46.507+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f85f40b3120 con 0x7f85f40ca320 2023-06-09T04:38:47.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.095+0000 7f85f17fa700 1 -- 172.21.15.26:0/2711412895 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v50) v1 ==== 147+0+0 (secure 0 0 0) 0x7f85f40b3120 con 0x7f85f40ca320 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.097+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85d806ace0 msgr2=0x7f85d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.097+0000 7f85fab15700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85d806ace0 0x7f85d806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e001c040 comp rx=0 tx=0).stop 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.097+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 msgr2=0x7f85f40b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.097+0000 7f85fab15700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f40b1d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85e800c580 tx=0x7f85e800c940 comp rx=0 tx=0).stop 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.097+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 shutdown_connections 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f41591d0 0x7f85f414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85d806ace0 0x7f85d806d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85f40ca320 0x7f85f40b1d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 --2- 172.21.15.26:0/2711412895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85f40cd530 0x7f85f415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 >> 172.21.15.26:0/2711412895 conn(0x7f85f40cb9d0 msgr2=0x7f85f406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 shutdown_connections 2023-06-09T04:38:47.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.098+0000 7f85fab15700 1 -- 172.21.15.26:0/2711412895 wait complete. 2023-06-09T04:38:47.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-09T04:38:47.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.246+0000 7fea45b33700 1 Processor -- start 2023-06-09T04:38:47.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.246+0000 7fea45b33700 1 -- start start 2023-06-09T04:38:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.247+0000 7fea45b33700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.247+0000 7fea45b33700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fea40098ea0 0x7fea40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.247+0000 7fea45b33700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea400cd880 con 0x7fea4015a6e0 2023-06-09T04:38:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.247+0000 7fea45b33700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea400ce280 con 0x7fea40098ea0 2023-06-09T04:38:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.247+0000 7fea45b33700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea400acb20 con 0x7fea4015a310 2023-06-09T04:38:47.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3f7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fea40098ea0 0x7fea40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3effd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fea4015a6e0 0x7fea400ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:46564/0 (socket says 172.21.15.26:46564) 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3effd700 1 -- 172.21.15.26:0/3934333769 learned_addr learned my addr 172.21.15.26:0/3934333769 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3f7fe700 1 -- 172.21.15.26:0/3934333769 >> v2:172.21.15.104:3300/0 conn(0x7fea40098ea0 msgr2=0x7fea40069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3f7fe700 1 --2- 172.21.15.26:0/3934333769 >> v2:172.21.15.104:3300/0 conn(0x7fea40098ea0 0x7fea40069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3f7fe700 1 -- 172.21.15.26:0/3934333769 >> v1:172.21.15.104:6789/0 conn(0x7fea4015a6e0 legacy=0x7fea400ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3f7fe700 1 -- 172.21.15.26:0/3934333769 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400cdb60 con 0x7fea4015a310 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3ffff700 1 --2- 172.21.15.26:0/3934333769 >> v2:172.21.15.104:3300/0 conn(0x7fea40098ea0 0x7fea40069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3f7fe700 1 --2- 172.21.15.26:0/3934333769 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400cede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea30009820 tx=0x7fea30009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=574b764f595c419f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3e7fc700 1 -- 172.21.15.26:0/3934333769 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30005e30 con 0x7fea4015a310 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3e7fc700 1 -- 172.21.15.26:0/3934333769 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea30006030 con 0x7fea4015a310 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.248+0000 7fea3e7fc700 1 -- 172.21.15.26:0/3934333769 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300063c0 con 0x7fea4015a310 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 -- 172.21.15.26:0/3934333769 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 msgr2=0x7fea400cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 --2- 172.21.15.26:0/3934333769 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400cede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea30009820 tx=0x7fea30009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 -- 172.21.15.26:0/3934333769 shutdown_connections 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 --2- 172.21.15.26:0/3934333769 >> v2:172.21.15.104:3300/0 conn(0x7fea40098ea0 0x7fea40069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 --2- 172.21.15.26:0/3934333769 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400cede0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 -- 172.21.15.26:0/3934333769 >> 172.21.15.26:0/3934333769 conn(0x7fea40098a30 msgr2=0x7fea400cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 -- 172.21.15.26:0/3934333769 shutdown_connections 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.249+0000 7fea45b33700 1 -- 172.21.15.26:0/3934333769 wait complete. 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.250+0000 7fea45b33700 1 Processor -- start 2023-06-09T04:38:47.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.250+0000 7fea45b33700 1 -- start start 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea45b33700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea40098ea0 0x7fea40152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea45b33700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea45b33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 0x7fea400ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea45b33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea40152da0 con 0x7fea4015a6e0 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea45b33700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea400c6da0 con 0x7fea40098ea0 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea45b33700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4015b250 con 0x7fea4015a310 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 0x7fea400ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 0x7fea400ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38800/0 (socket says 172.21.15.26:38800) 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 -- 172.21.15.26:0/3943608666 learned_addr learned my addr 172.21.15.26:0/3943608666 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3effd700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3f7fe700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea40098ea0 0x7fea40152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 -- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 msgr2=0x7fea400c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 -- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea40098ea0 msgr2=0x7fea40152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea40098ea0 0x7fea40152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.251+0000 7fea3ffff700 1 -- 172.21.15.26:0/3943608666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38009a70 con 0x7fea4015a6e0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.252+0000 7fea3ffff700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 0x7fea400ca370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea3800efc0 tx=0x7fea3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.252+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3800ca90 con 0x7fea4015a6e0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.252+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3800f040 con 0x7fea4015a6e0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.252+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea30009430 con 0x7fea4015a6e0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.252+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3800ce30 con 0x7fea4015a6e0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.252+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4015af70 con 0x7fea4015a6e0 2023-06-09T04:38:47.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.253+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea40067180 con 0x7fea4015a6e0 2023-06-09T04:38:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.253+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea38014480 con 0x7fea4015a6e0 2023-06-09T04:38:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.254+0000 7fea37fff700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fea2006ace0 0x7fea2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.254+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea38089ae0 con 0x7fea4015a6e0 2023-06-09T04:38:47.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.254+0000 7fea3f7fe700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fea2006ace0 0x7fea2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.255+0000 7fea3f7fe700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fea2006ace0 0x7fea2006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea30000c00 tx=0x7fea30008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:47.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.259+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fea38054b90 con 0x7fea4015a6e0 2023-06-09T04:38:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.460+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fea401e3150 con 0x7fea4015a6e0 2023-06-09T04:38:47.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.464+0000 7fea37fff700 1 -- 172.21.15.26:0/3943608666 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fea38009cd0 con 0x7fea4015a6e0 2023-06-09T04:38:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fea2006ace0 msgr2=0x7fea2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fea2006ace0 0x7fea2006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea30000c00 tx=0x7fea30008070 comp rx=0 tx=0).stop 2023-06-09T04:38:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 msgr2=0x7fea400ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 0x7fea400ca370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea3800efc0 tx=0x7fea3800c3a0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 shutdown_connections 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fea2006ace0 0x7fea2006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea4015a6e0 0x7fea400ca370 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea40098ea0 0x7fea40152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 --2- 172.21.15.26:0/3943608666 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fea4015a310 0x7fea400c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 >> 172.21.15.26:0/3943608666 conn(0x7fea40098a30 msgr2=0x7fea400ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:47.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 shutdown_connections 2023-06-09T04:38:47.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.466+0000 7fea45b33700 1 -- 172.21.15.26:0/3943608666 wait complete. 2023-06-09T04:38:47.479 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T04:38:47.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:38:47.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:38:47.565 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T04:38:47.566 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:38:47.566 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:47.583 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:38:47.583 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:47.640 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:47.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:47.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:47.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.804+0000 7f0c91fbc700 1 Processor -- start 2023-06-09T04:38:47.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.804+0000 7f0c91fbc700 1 -- start start 2023-06-09T04:38:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c91fbc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c8c0cd600 0x7f0c8c0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c91fbc700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0cc160 con 0x7f0c8c15f9d0 2023-06-09T04:38:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c91fbc700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c15fda0 con 0x7f0c8c0cec00 2023-06-09T04:38:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c91fbc700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cf240 con 0x7f0c8c0cd600 2023-06-09T04:38:47.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c8bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c8c0cd600 0x7f0c8c0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c8b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0c8c15f9d0 0x7f0c8c0ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47662/0 (socket says 172.21.15.26:47662) 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.805+0000 7f0c8b7fe700 1 -- 172.21.15.26:0/438262350 learned_addr learned my addr 172.21.15.26:0/438262350 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8bfff700 1 -- 172.21.15.26:0/438262350 >> v1:172.21.15.104:6789/0 conn(0x7f0c8c0cec00 legacy=0x7f0c8c06aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8bfff700 1 -- 172.21.15.26:0/438262350 >> v1:172.21.15.26:6789/0 conn(0x7f0c8c15f9d0 legacy=0x7f0c8c0ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8bfff700 1 -- 172.21.15.26:0/438262350 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0cb550 con 0x7f0c8c0cd600 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8a7fc700 1 -- 172.21.15.26:0/438262350 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997769208 0 0) 0x7f0c8c0cc160 con 0x7f0c8c15f9d0 2023-06-09T04:38:47.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/438262350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c0caf70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebd01bdfa8a1f79 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8a7fc700 1 -- 172.21.15.26:0/438262350 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400e070 con 0x7f0c8c0cd600 2023-06-09T04:38:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8a7fc700 1 -- 172.21.15.26:0/438262350 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400bbd0 con 0x7f0c8c0cd600 2023-06-09T04:38:47.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.806+0000 7f0c8a7fc700 1 -- 172.21.15.26:0/438262350 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84012430 con 0x7f0c8c0cd600 2023-06-09T04:38:47.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 -- 172.21.15.26:0/438262350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 msgr2=0x7f0c8c0caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/438262350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c0caf70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 -- 172.21.15.26:0/438262350 shutdown_connections 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/438262350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c0caf70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 -- 172.21.15.26:0/438262350 >> 172.21.15.26:0/438262350 conn(0x7f0c8c089fc0 msgr2=0x7f0c8c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 -- 172.21.15.26:0/438262350 shutdown_connections 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.807+0000 7f0c91fbc700 1 -- 172.21.15.26:0/438262350 wait complete. 2023-06-09T04:38:47.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.808+0000 7f0c91fbc700 1 Processor -- start 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.808+0000 7f0c91fbc700 1 -- start start 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c91fbc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c91fbc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c8c0cec00 0x7f0c8c0c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c91fbc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0c8c15f9d0 0x7f0c8c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c91fbc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15e360 con 0x7f0c8c0cd600 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c91fbc700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0b6790 con 0x7f0c8c0cec00 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c91fbc700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0b56f0 con 0x7f0c8c15f9d0 2023-06-09T04:38:47.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38810/0 (socket says 172.21.15.26:38810) 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 -- 172.21.15.26:0/2957631576 learned_addr learned my addr 172.21.15.26:0/2957631576 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8affd700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c8c0cec00 0x7f0c8c0c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0c8c15f9d0 0x7f0c8c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 -- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0c8c15f9d0 msgr2=0x7f0c8c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0c8c15f9d0 0x7f0c8c0c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 -- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c8c0cec00 msgr2=0x7f0c8c0c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c8c0cec00 0x7f0c8c0c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 -- 172.21.15.26:0/2957631576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c84009a70 con 0x7f0c8c0cd600 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8bfff700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0c8c15f9d0 0x7f0c8c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8affd700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c8c0cec00 0x7f0c8c0c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.809+0000 7f0c8b7fe700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c15d920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c730 tx=0x7f0c7c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.810+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0074e0 con 0x7f0c8c0cd600 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.810+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c007660 con 0x7f0c8c0cd600 2023-06-09T04:38:47.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.810+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c0b59d0 con 0x7f0c8c0cd600 2023-06-09T04:38:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.810+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c005a70 con 0x7f0c8c0cd600 2023-06-09T04:38:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.810+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c0b5f90 con 0x7f0c8c0cd600 2023-06-09T04:38:47.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.810+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c15e500 con 0x7f0c8c0cd600 2023-06-09T04:38:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.811+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c7c005bd0 con 0x7f0c8c0cd600 2023-06-09T04:38:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.812+0000 7f0c83fff700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0c6c06ace0 0x7f0c6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.812+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c7c088de0 con 0x7f0c8c0cd600 2023-06-09T04:38:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.812+0000 7f0c8affd700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0c6c06ace0 0x7f0c6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.812+0000 7f0c8affd700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0c6c06ace0 0x7f0c6c06d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c09e800 tx=0x7f0c74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:47.816+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c7c053e90 con 0x7f0c8c0cd600 2023-06-09T04:38:48.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.015+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c8c0d0e10 con 0x7f0c8c0cd600 2023-06-09T04:38:48.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.017+0000 7f0c83fff700 1 -- 172.21.15.26:0/2957631576 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f0c7c017090 con 0x7f0c8c0cd600 2023-06-09T04:38:48.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:48.018 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0c6c06ace0 msgr2=0x7f0c6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0c6c06ace0 0x7f0c6c06d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c09e800 tx=0x7f0c74009040 comp rx=0 tx=0).stop 2023-06-09T04:38:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 msgr2=0x7f0c8c15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c15d920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c730 tx=0x7f0c7c00caf0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 shutdown_connections 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0c8c15f9d0 0x7f0c8c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f0c6c06ace0 0x7f0c6c06d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c8c0cd600 0x7f0c8c15d920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 --2- 172.21.15.26:0/2957631576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c8c0cec00 0x7f0c8c0c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 >> 172.21.15.26:0/2957631576 conn(0x7f0c8c089fc0 msgr2=0x7f0c8c06c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 shutdown_connections 2023-06-09T04:38:48.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.019+0000 7f0c91fbc700 1 -- 172.21.15.26:0/2957631576 wait complete. 2023-06-09T04:38:48.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:48.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:48.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.198+0000 7fc7ae4e6700 1 Processor -- start 2023-06-09T04:38:48.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.198+0000 7fc7ae4e6700 1 -- start start 2023-06-09T04:38:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7ae4e6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a6e0 0x7fc7a80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7ae4e6700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7a8098ea0 0x7fc7a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7ae4e6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a80cd880 con 0x7fc7a815a310 2023-06-09T04:38:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7ae4e6700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80ce280 con 0x7fc7a8098ea0 2023-06-09T04:38:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7ae4e6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80acb20 con 0x7fc7a815a6e0 2023-06-09T04:38:48.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7aca83700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7a8098ea0 0x7fc7a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7aca83700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7a8098ea0 0x7fc7a8069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38820/0 (socket says 172.21.15.26:38820) 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.199+0000 7fc7aca83700 1 -- 172.21.15.26:0/2882182687 learned_addr learned my addr 172.21.15.26:0/2882182687 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7a77fe700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a6e0 0x7fc7a80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7aca83700 1 -- 172.21.15.26:0/2882182687 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a6e0 msgr2=0x7fc7a80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7aca83700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a6e0 0x7fc7a80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7aca83700 1 -- 172.21.15.26:0/2882182687 >> v1:172.21.15.26:6789/0 conn(0x7fc7a815a310 legacy=0x7fc7a80ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7a6ffd700 1 -- 172.21.15.26:0/2882182687 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827650534 0 0) 0x7fc7a80cd880 con 0x7fc7a815a310 2023-06-09T04:38:48.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7aca83700 1 -- 172.21.15.26:0/2882182687 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80cdb60 con 0x7fc7a8098ea0 2023-06-09T04:38:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7a77fe700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a6e0 0x7fc7a80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7aca83700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a8098ea0 0x7fc7a8069db0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009e50 tx=0x7fc7a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c4aaa4bc2e438f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7a6ffd700 1 -- 172.21.15.26:0/2882182687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a000e070 con 0x7fc7a8098ea0 2023-06-09T04:38:48.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7a6ffd700 1 -- 172.21.15.26:0/2882182687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a000b9c0 con 0x7fc7a8098ea0 2023-06-09T04:38:48.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.200+0000 7fc7a6ffd700 1 -- 172.21.15.26:0/2882182687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a000bd70 con 0x7fc7a8098ea0 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/2882182687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a8098ea0 msgr2=0x7fc7a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a8098ea0 0x7fc7a8069db0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009e50 tx=0x7fc7a000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/2882182687 shutdown_connections 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a8098ea0 0x7fc7a8069db0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/2882182687 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a6e0 0x7fc7a80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/2882182687 >> 172.21.15.26:0/2882182687 conn(0x7fc7a8098a30 msgr2=0x7fc7a80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/2882182687 shutdown_connections 2023-06-09T04:38:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.201+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/2882182687 wait complete. 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.202+0000 7fc7ae4e6700 1 Processor -- start 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.202+0000 7fc7ae4e6700 1 -- start start 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7ae4e6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a8098ea0 0x7fc7a81596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7ae4e6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a310 0x7fc7a80c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7ae4e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 0x7fc7a80c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7ae4e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c39f0 con 0x7fc7a815a6e0 2023-06-09T04:38:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7ae4e6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c8470 con 0x7fc7a8098ea0 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7ae4e6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c8750 con 0x7fc7a815a310 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 0x7fc7a80c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 0x7fc7a80c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38826/0 (socket says 172.21.15.26:38826) 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 -- 172.21.15.26:0/1446479253 learned_addr learned my addr 172.21.15.26:0/1446479253 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7a77fe700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a310 0x7fc7a80c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7a7fff700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a8098ea0 0x7fc7a81596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 -- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a310 msgr2=0x7fc7a80c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a310 0x7fc7a80c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 -- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a8098ea0 msgr2=0x7fc7a81596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a8098ea0 0x7fc7a81596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 -- 172.21.15.26:0/1446479253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0009b30 con 0x7fc7a815a6e0 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7a77fe700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a310 0x7fc7a80c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7a7fff700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a8098ea0 0x7fc7a81596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.203+0000 7fc7aca83700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 0x7fc7a80c32f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000b730 tx=0x7fc7a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.204+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00099b0 con 0x7fc7a815a6e0 2023-06-09T04:38:48.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.204+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a00092e0 con 0x7fc7a815a6e0 2023-06-09T04:38:48.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.204+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a80c8a30 con 0x7fc7a815a6e0 2023-06-09T04:38:48.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.204+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a001b650 con 0x7fc7a815a6e0 2023-06-09T04:38:48.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.204+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a8145b70 con 0x7fc7a815a6e0 2023-06-09T04:38:48.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.205+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8067180 con 0x7fc7a815a6e0 2023-06-09T04:38:48.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.205+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7a001b7b0 con 0x7fc7a815a6e0 2023-06-09T04:38:48.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.206+0000 7fc7a4ff9700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc79406ace0 0x7fc79406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.206+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7a008ae10 con 0x7fc7a815a6e0 2023-06-09T04:38:48.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.206+0000 7fc7a7fff700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc79406ace0 0x7fc79406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.206+0000 7fc7a7fff700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc79406ace0 0x7fc79406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7a806fd20 tx=0x7fc798009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.210+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7a008e030 con 0x7fc7a815a6e0 2023-06-09T04:38:48.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.405+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7a81e48d0 con 0x7fc7a815a6e0 2023-06-09T04:38:48.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.406+0000 7fc7a4ff9700 1 -- 172.21.15.26:0/1446479253 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7a0055eb0 con 0x7fc7a815a6e0 2023-06-09T04:38:48.407 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:48.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc79406ace0 msgr2=0x7fc79406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc79406ace0 0x7fc79406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7a806fd20 tx=0x7fc798009040 comp rx=0 tx=0).stop 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 msgr2=0x7fc7a80c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 0x7fc7a80c32f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000b730 tx=0x7fc7a0004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 shutdown_connections 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc79406ace0 0x7fc79406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7a815a6e0 0x7fc7a80c32f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a8098ea0 0x7fc7a81596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 --2- 172.21.15.26:0/1446479253 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7a815a310 0x7fc7a80c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 >> 172.21.15.26:0/1446479253 conn(0x7fc7a8098a30 msgr2=0x7fc7a8155bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:48.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 shutdown_connections 2023-06-09T04:38:48.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.408+0000 7fc7ae4e6700 1 -- 172.21.15.26:0/1446479253 wait complete. 2023-06-09T04:38:48.421 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.548+0000 7fcb972d6700 1 Processor -- start 2023-06-09T04:38:48.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.548+0000 7fcb972d6700 1 -- start start 2023-06-09T04:38:48.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb972d6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb9006a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb972d6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9006f190 con 0x7fcb900aed50 2023-06-09T04:38:48.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb972d6700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9006e440 con 0x7fcb9015c6e0 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb972d6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9006e690 con 0x7fcb9006e990 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb94871700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb900aed50 0x7fcb90069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47690/0 (socket says 172.21.15.26:47690) 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb94871700 1 -- 172.21.15.26:0/779933374 learned_addr learned my addr 172.21.15.26:0/779933374 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.549+0000 7fcb95873700 1 --2- 172.21.15.26:0/779933374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb9006a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064612070 0 0) 0x7fcb9006f190 con 0x7fcb900aed50 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7c0035b0 con 0x7fcb900aed50 2023-06-09T04:38:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288612682 0 0) 0x7fcb9006e440 con 0x7fcb9015c6e0 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb9006f190 con 0x7fcb9015c6e0 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb95873700 1 -- 172.21.15.26:0/779933374 >> v1:172.21.15.104:6789/0 conn(0x7fcb9015c6e0 legacy=0x7fcb900ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 611193577 0 0) 0x7fcb7c0035b0 con 0x7fcb900aed50 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb95873700 1 -- 172.21.15.26:0/779933374 >> v1:172.21.15.26:6789/0 conn(0x7fcb900aed50 legacy=0x7fcb90069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb95873700 1 -- 172.21.15.26:0/779933374 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90160300 con 0x7fcb9006e990 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb95873700 1 --2- 172.21.15.26:0/779933374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb9006a4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009dc0 tx=0x7fcb8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=143cbf05ef4fa025 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800e070 con 0x7fcb9006e990 2023-06-09T04:38:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88003a20 con 0x7fcb9006e990 2023-06-09T04:38:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.550+0000 7fcb87fff700 1 -- 172.21.15.26:0/779933374 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c001670 con 0x7fcb9006e990 2023-06-09T04:38:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 -- 172.21.15.26:0/779933374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 msgr2=0x7fcb9006a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 --2- 172.21.15.26:0/779933374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb9006a4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009dc0 tx=0x7fcb8800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 -- 172.21.15.26:0/779933374 shutdown_connections 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 --2- 172.21.15.26:0/779933374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb9006a4c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 -- 172.21.15.26:0/779933374 >> 172.21.15.26:0/779933374 conn(0x7fcb90098a30 msgr2=0x7fcb900cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 -- 172.21.15.26:0/779933374 shutdown_connections 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.551+0000 7fcb972d6700 1 -- 172.21.15.26:0/779933374 wait complete. 2023-06-09T04:38:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.552+0000 7fcb972d6700 1 Processor -- start 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.552+0000 7fcb972d6700 1 -- start start 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb972d6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb90152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb972d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 0x7fcb900af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb972d6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb9015c6e0 0x7fcb901f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb972d6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90156ed0 con 0x7fcb900aed50 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb972d6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901571b0 con 0x7fcb9015c6e0 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb972d6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90157490 con 0x7fcb9006e990 2023-06-09T04:38:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 0x7fcb900af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 0x7fcb900af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38838/0 (socket says 172.21.15.26:38838) 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 -- 172.21.15.26:0/2185815201 learned_addr learned my addr 172.21.15.26:0/2185815201 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb95072700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb90152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb95873700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb9015c6e0 0x7fcb901f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 -- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 msgr2=0x7fcb90152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb90152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 -- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb9015c6e0 msgr2=0x7fcb901f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb9015c6e0 0x7fcb901f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 -- 172.21.15.26:0/2185815201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88009a70 con 0x7fcb900aed50 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.553+0000 7fcb94871700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 0x7fcb900af170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0011e0 tx=0x7fcb8c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.554+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c004c80 con 0x7fcb900aed50 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.554+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c004e00 con 0x7fcb900aed50 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.554+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb90157770 con 0x7fcb900aed50 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.554+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c007310 con 0x7fcb900aed50 2023-06-09T04:38:48.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.554+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb901f5980 con 0x7fcb900aed50 2023-06-09T04:38:48.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.555+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90157010 con 0x7fcb900aed50 2023-06-09T04:38:48.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.555+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb8c007470 con 0x7fcb900aed50 2023-06-09T04:38:48.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.556+0000 7fcb85ffb700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcb7406ace0 0x7fcb7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.556+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb8c0892c0 con 0x7fcb900aed50 2023-06-09T04:38:48.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.556+0000 7fcb95072700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcb7406ace0 0x7fcb7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.557+0000 7fcb95072700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcb7406ace0 0x7fcb7406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb80001270 tx=0x7fcb80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.560+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcb90157010 con 0x7fcb900aed50 2023-06-09T04:38:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.755+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb90157010 con 0x7fcb900aed50 2023-06-09T04:38:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.756+0000 7fcb85ffb700 1 -- 172.21.15.26:0/2185815201 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb90157010 con 0x7fcb900aed50 2023-06-09T04:38:48.757 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcb7406ace0 msgr2=0x7fcb7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcb7406ace0 0x7fcb7406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb80001270 tx=0x7fcb80009040 comp rx=0 tx=0).stop 2023-06-09T04:38:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 msgr2=0x7fcb900af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 0x7fcb900af170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0011e0 tx=0x7fcb8c00cae0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 shutdown_connections 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcb9015c6e0 0x7fcb901f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcb9006e990 0x7fcb90152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcb7406ace0 0x7fcb7406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 --2- 172.21.15.26:0/2185815201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb900aed50 0x7fcb900af170 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 >> 172.21.15.26:0/2185815201 conn(0x7fcb90098a30 msgr2=0x7fcb900cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 shutdown_connections 2023-06-09T04:38:48.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.758+0000 7fcb972d6700 1 -- 172.21.15.26:0/2185815201 wait complete. 2023-06-09T04:38:48.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:48.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.896+0000 7ff377920700 1 Processor -- start 2023-06-09T04:38:48.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.897+0000 7ff377920700 1 -- start start 2023-06-09T04:38:48.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.897+0000 7ff377920700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff37015c6e0 0x7ff3700ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.897+0000 7ff377920700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff370098e30 0x7ff3700aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.897+0000 7ff377920700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37006f190 con 0x7ff37006e990 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.897+0000 7ff377920700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37006e440 con 0x7ff370098e30 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.897+0000 7ff377920700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37006e690 con 0x7ff37015c6e0 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff370098e30 0x7ff3700aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff374ebb700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff37006e990 0x7ff3700cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47702/0 (socket says 172.21.15.26:47702) 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff370098e30 0x7ff3700aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38848/0 (socket says 172.21.15.26:38848) 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff374ebb700 1 -- 172.21.15.26:0/2724138074 learned_addr learned my addr 172.21.15.26:0/2724138074 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:48.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 -- 172.21.15.26:0/2724138074 >> v2:172.21.15.104:3300/0 conn(0x7ff37015c6e0 msgr2=0x7ff3700ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff3756bc700 1 --2- 172.21.15.26:0/2724138074 >> v2:172.21.15.104:3300/0 conn(0x7ff37015c6e0 0x7ff3700ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 --2- 172.21.15.26:0/2724138074 >> v2:172.21.15.104:3300/0 conn(0x7ff37015c6e0 0x7ff3700ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 -- 172.21.15.26:0/2724138074 >> v1:172.21.15.26:6789/0 conn(0x7ff37006e990 legacy=0x7ff3700cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff363fff700 1 -- 172.21.15.26:0/2724138074 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556639508 0 0) 0x7ff37006f190 con 0x7ff37006e990 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 -- 172.21.15.26:0/2724138074 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370160300 con 0x7ff370098e30 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff3756bc700 1 --2- 172.21.15.26:0/2724138074 >> v2:172.21.15.104:3300/0 conn(0x7ff37015c6e0 0x7ff3700ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:48.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff375ebd700 1 --2- 172.21.15.26:0/2724138074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff3700aeb80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3700b23a0 tx=0x7ff36800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be96de32cb53246e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff363fff700 1 -- 172.21.15.26:0/2724138074 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800e070 con 0x7ff370098e30 2023-06-09T04:38:48.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff363fff700 1 -- 172.21.15.26:0/2724138074 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800bbd0 con 0x7ff370098e30 2023-06-09T04:38:48.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.898+0000 7ff363fff700 1 -- 172.21.15.26:0/2724138074 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368012430 con 0x7ff370098e30 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 -- 172.21.15.26:0/2724138074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 msgr2=0x7ff3700aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 --2- 172.21.15.26:0/2724138074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff3700aeb80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3700b23a0 tx=0x7ff36800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 -- 172.21.15.26:0/2724138074 shutdown_connections 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 --2- 172.21.15.26:0/2724138074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff3700aeb80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 --2- 172.21.15.26:0/2724138074 >> v2:172.21.15.104:3300/0 conn(0x7ff37015c6e0 0x7ff3700ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 -- 172.21.15.26:0/2724138074 >> 172.21.15.26:0/2724138074 conn(0x7ff370098a30 msgr2=0x7ff3700cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 -- 172.21.15.26:0/2724138074 shutdown_connections 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.899+0000 7ff377920700 1 -- 172.21.15.26:0/2724138074 wait complete. 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.900+0000 7ff377920700 1 Processor -- start 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.900+0000 7ff377920700 1 -- start start 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff377920700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff37006e990 0x7ff370153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff377920700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff37015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff377920700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff37015c6e0 0x7ff3701f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff377920700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700b52d0 con 0x7ff370098e30 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff377920700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700b55b0 con 0x7ff37015c6e0 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff377920700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700c9590 con 0x7ff37006e990 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff37015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff37015b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38852/0 (socket says 172.21.15.26:38852) 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 -- 172.21.15.26:0/3430211335 learned_addr learned my addr 172.21.15.26:0/3430211335 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff3756bc700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff37006e990 0x7ff370153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff375ebd700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff37015c6e0 0x7ff3701f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 -- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff37006e990 msgr2=0x7ff370153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff37006e990 0x7ff370153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 -- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff37015c6e0 msgr2=0x7ff3701f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff37015c6e0 0x7ff3701f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.901+0000 7ff374ebb700 1 -- 172.21.15.26:0/3430211335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368009a70 con 0x7ff370098e30 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.902+0000 7ff374ebb700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff37015b760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c550 tx=0x7ff36400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.902+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364004c80 con 0x7ff370098e30 2023-06-09T04:38:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.902+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff364004e00 con 0x7ff370098e30 2023-06-09T04:38:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.902+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3700c9870 con 0x7ff370098e30 2023-06-09T04:38:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.902+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364007310 con 0x7ff370098e30 2023-06-09T04:38:48.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.902+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3700b4ef0 con 0x7ff370098e30 2023-06-09T04:38:48.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.903+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370067180 con 0x7ff370098e30 2023-06-09T04:38:48.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.903+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff364007470 con 0x7ff370098e30 2023-06-09T04:38:48.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.904+0000 7ff361ffb700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff35406ace0 0x7ff35406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:48.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.904+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff364089090 con 0x7ff370098e30 2023-06-09T04:38:48.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.904+0000 7ff3756bc700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff35406ace0 0x7ff35406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:48.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.904+0000 7ff3756bc700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff35406ace0 0x7ff35406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00ab40 tx=0x7ff36c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:48.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:48.908+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff364054140 con 0x7ff370098e30 2023-06-09T04:38:49.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.105+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3700ce6f0 con 0x7ff370098e30 2023-06-09T04:38:49.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.106+0000 7ff361ffb700 1 -- 172.21.15.26:0/3430211335 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff364057760 con 0x7ff370098e30 2023-06-09T04:38:49.107 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff35406ace0 msgr2=0x7ff35406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff35406ace0 0x7ff35406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00ab40 tx=0x7ff36c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 msgr2=0x7ff37015b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff37015b760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c550 tx=0x7ff36400c860 comp rx=0 tx=0).stop 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 shutdown_connections 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff37015c6e0 0x7ff3701f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff37006e990 0x7ff370153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff35406ace0 0x7ff35406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 --2- 172.21.15.26:0/3430211335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff370098e30 0x7ff37015b760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 >> 172.21.15.26:0/3430211335 conn(0x7ff370098a30 msgr2=0x7ff3700ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 shutdown_connections 2023-06-09T04:38:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.108+0000 7ff377920700 1 -- 172.21.15.26:0/3430211335 wait complete. 2023-06-09T04:38:49.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.248+0000 7fc4bd4ea700 1 Processor -- start 2023-06-09T04:38:49.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.248+0000 7fc4bd4ea700 1 -- start start 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4bd4ea700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4bd4ea700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc4b80cf370 0x7fc4b80d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4bd4ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b815d3e0 0x7fc4b80d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4bd4ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80d0970 con 0x7fc4b815d3e0 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4bd4ea700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80d1840 con 0x7fc4b80cf370 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4bd4ea700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b815d950 con 0x7fc4b81569b0 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b815d3e0 0x7fc4b80d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4b815d3e0 0x7fc4b80d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38862/0 (socket says 172.21.15.26:38862) 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 -- 172.21.15.26:0/1997505954 learned_addr learned my addr 172.21.15.26:0/1997505954 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b67fc700 1 --2- 172.21.15.26:0/1997505954 >> v2:172.21.15.104:3300/0 conn(0x7fc4b80cf370 0x7fc4b80d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 -- 172.21.15.26:0/1997505954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 msgr2=0x7fc4b80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 -- 172.21.15.26:0/1997505954 >> v2:172.21.15.104:3300/0 conn(0x7fc4b80cf370 msgr2=0x7fc4b80d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 --2- 172.21.15.26:0/1997505954 >> v2:172.21.15.104:3300/0 conn(0x7fc4b80cf370 0x7fc4b80d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b77fe700 1 -- 172.21.15.26:0/1997505954 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80cd360 con 0x7fc4b815d3e0 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.249+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4b77fe700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b815d3e0 0x7fc4b80d1300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80d3bf0 tx=0x7fc4b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a87a2b3739a926 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4b5ffb700 1 -- 172.21.15.26:0/1997505954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000e070 con 0x7fc4b815d3e0 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4b5ffb700 1 -- 172.21.15.26:0/1997505954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000b910 con 0x7fc4b815d3e0 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4b5ffb700 1 -- 172.21.15.26:0/1997505954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000bcc0 con 0x7fc4b815d3e0 2023-06-09T04:38:49.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/1997505954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b815d3e0 msgr2=0x7fc4b80d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b815d3e0 0x7fc4b80d1300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80d3bf0 tx=0x7fc4b000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/1997505954 shutdown_connections 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b815d3e0 0x7fc4b80d1300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/1997505954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/1997505954 >> v2:172.21.15.104:3300/0 conn(0x7fc4b80cf370 0x7fc4b80d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/1997505954 >> 172.21.15.26:0/1997505954 conn(0x7fc4b806b1f0 msgr2=0x7fc4b806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/1997505954 shutdown_connections 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.250+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/1997505954 wait complete. 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 Processor -- start 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 -- start start 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 0x7fc4b81e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b81f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4b815d3e0 0x7fc4b8071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b81e5f80 con 0x7fc4b80cf370 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b81f6660 con 0x7fc4b815d3e0 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.252+0000 7fc4bd4ea700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b81e5300 con 0x7fc4b81569b0 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 0x7fc4b81e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 0x7fc4b81e4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38864/0 (socket says 172.21.15.26:38864) 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/3060239978 learned_addr learned my addr 172.21.15.26:0/3060239978 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 msgr2=0x7fc4b81f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b81f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4b815d3e0 msgr2=0x7fc4b8071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4b815d3e0 0x7fc4b8071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 -- 172.21.15.26:0/3060239978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009b30 con 0x7fc4b80cf370 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4b6ffd700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 0x7fc4b81e4bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00e810 tx=0x7fc4ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac005c20 con 0x7fc4b80cf370 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac005d80 con 0x7fc4b80cf370 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b81e55e0 con 0x7fc4b80cf370 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac006250 con 0x7fc4b80cf370 2023-06-09T04:38:49.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.253+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b81e5ba0 con 0x7fc4b80cf370 2023-06-09T04:38:49.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.254+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b81e60c0 con 0x7fc4b80cf370 2023-06-09T04:38:49.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.255+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4ac0063b0 con 0x7fc4b80cf370 2023-06-09T04:38:49.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.255+0000 7fc49f7fe700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc4a406ace0 0x7fc4a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.255+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4ac088e60 con 0x7fc4b80cf370 2023-06-09T04:38:49.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.255+0000 7fc4b67fc700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc4a406ace0 0x7fc4a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.256+0000 7fc4b67fc700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc4a406ace0 0x7fc4a406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8006b20 tx=0x7fc4a8006ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.259+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc4ac053fa0 con 0x7fc4b80cf370 2023-06-09T04:38:49.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.453+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4b8074080 con 0x7fc4b80cf370 2023-06-09T04:38:49.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.453+0000 7fc49f7fe700 1 -- 172.21.15.26:0/3060239978 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4ac0200a0 con 0x7fc4b80cf370 2023-06-09T04:38:49.454 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:49.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc4a406ace0 msgr2=0x7fc4a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc4a406ace0 0x7fc4a406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8006b20 tx=0x7fc4a8006ab0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 msgr2=0x7fc4b81e4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 0x7fc4b81e4bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00e810 tx=0x7fc4ac00ebd0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 shutdown_connections 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4b815d3e0 0x7fc4b8071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc4a406ace0 0x7fc4a406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4b80cf370 0x7fc4b81e4bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 --2- 172.21.15.26:0/3060239978 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc4b81569b0 0x7fc4b81f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 >> 172.21.15.26:0/3060239978 conn(0x7fc4b806b1f0 msgr2=0x7fc4b815f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 shutdown_connections 2023-06-09T04:38:49.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.455+0000 7fc4bd4ea700 1 -- 172.21.15.26:0/3060239978 wait complete. 2023-06-09T04:38:49.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:49.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.593+0000 7fd3b3996700 1 Processor -- start 2023-06-09T04:38:49.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.593+0000 7fd3b3996700 1 -- start start 2023-06-09T04:38:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b3996700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3ac0ccc90 0x7fd3ac0ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b3996700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac0cc0f0 con 0x7fd3ac0caf70 2023-06-09T04:38:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b3996700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac0cb4e0 con 0x7fd3ac15d780 2023-06-09T04:38:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b3996700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b00a0 con 0x7fd3ac0ccc90 2023-06-09T04:38:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b1f33700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3ac0ccc90 0x7fd3ac0ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b0f31700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd3ac0caf70 0x7fd3ac0cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47730/0 (socket says 172.21.15.26:47730) 2023-06-09T04:38:49.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b0f31700 1 -- 172.21.15.26:0/3969618254 learned_addr learned my addr 172.21.15.26:0/3969618254 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b1f33700 1 -- 172.21.15.26:0/3969618254 >> v1:172.21.15.104:6789/0 conn(0x7fd3ac15d780 legacy=0x7fd3ac0b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b1f33700 1 -- 172.21.15.26:0/3969618254 >> v1:172.21.15.26:6789/0 conn(0x7fd3ac0caf70 legacy=0x7fd3ac0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b1f33700 1 -- 172.21.15.26:0/3969618254 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0cb7c0 con 0x7fd3ac0ccc90 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3b1f33700 1 --2- 172.21.15.26:0/3969618254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac0ccc90 0x7fd3ac0ce4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009d90 tx=0x7fd3a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8257aba90a316b18 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3a3fff700 1 -- 172.21.15.26:0/3969618254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400e070 con 0x7fd3ac0ccc90 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3a3fff700 1 -- 172.21.15.26:0/3969618254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400bbd0 con 0x7fd3ac0ccc90 2023-06-09T04:38:49.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.594+0000 7fd3a3fff700 1 -- 172.21.15.26:0/3969618254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4012430 con 0x7fd3ac0ccc90 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 -- 172.21.15.26:0/3969618254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac0ccc90 msgr2=0x7fd3ac0ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 --2- 172.21.15.26:0/3969618254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac0ccc90 0x7fd3ac0ce4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009d90 tx=0x7fd3a400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 -- 172.21.15.26:0/3969618254 shutdown_connections 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 --2- 172.21.15.26:0/3969618254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac0ccc90 0x7fd3ac0ce4f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 -- 172.21.15.26:0/3969618254 >> 172.21.15.26:0/3969618254 conn(0x7fd3ac089fc0 msgr2=0x7fd3ac0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 -- 172.21.15.26:0/3969618254 shutdown_connections 2023-06-09T04:38:49.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.595+0000 7fd3b3996700 1 -- 172.21.15.26:0/3969618254 wait complete. 2023-06-09T04:38:49.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.596+0000 7fd3b3996700 1 Processor -- start 2023-06-09T04:38:49.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.596+0000 7fd3b3996700 1 -- start start 2023-06-09T04:38:49.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b3996700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3ac0caf70 0x7fd3ac14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b3996700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3ac0ccc90 0x7fd3ac0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b3996700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 0x7fd3ac0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b3996700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c4d30 con 0x7fd3ac15d780 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b3996700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c5010 con 0x7fd3ac0caf70 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b3996700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c52f0 con 0x7fd3ac0ccc90 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 0x7fd3ac0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 0x7fd3ac0c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38882/0 (socket says 172.21.15.26:38882) 2023-06-09T04:38:49.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 -- 172.21.15.26:0/1584180186 learned_addr learned my addr 172.21.15.26:0/1584180186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1732700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3ac0caf70 0x7fd3ac14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b0f31700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3ac0ccc90 0x7fd3ac0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 -- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3ac0ccc90 msgr2=0x7fd3ac0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3ac0ccc90 0x7fd3ac0c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 -- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3ac0caf70 msgr2=0x7fd3ac14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3ac0caf70 0x7fd3ac14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 -- 172.21.15.26:0/1584180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009a70 con 0x7fd3ac15d780 2023-06-09T04:38:49.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1732700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3ac0caf70 0x7fd3ac14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.597+0000 7fd3b1f33700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 0x7fd3ac0c4430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4014040 tx=0x7fd3a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.598+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40098f0 con 0x7fd3ac15d780 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.598+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4020070 con 0x7fd3ac15d780 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.598+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac0c55d0 con 0x7fd3ac15d780 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.598+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4004280 con 0x7fd3ac15d780 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.598+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac14f1b0 con 0x7fd3ac15d780 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.599+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac0c5af0 con 0x7fd3ac15d780 2023-06-09T04:38:49.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.599+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3a40043e0 con 0x7fd3ac15d780 2023-06-09T04:38:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.600+0000 7fd3a1ffb700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd39006ace0 0x7fd39006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.600+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3a4022070 con 0x7fd3ac15d780 2023-06-09T04:38:49.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.600+0000 7fd3b1732700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd39006ace0 0x7fd39006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.600+0000 7fd3b1732700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd39006ace0 0x7fd39006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd39c000fb0 tx=0x7fd39c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.604+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd3ac0c5af0 con 0x7fd3ac15d780 2023-06-09T04:38:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.820+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3ac0c5af0 con 0x7fd3ac15d780 2023-06-09T04:38:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.820+0000 7fd3a1ffb700 1 -- 172.21.15.26:0/1584180186 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd3ac0c5af0 con 0x7fd3ac15d780 2023-06-09T04:38:49.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd39006ace0 msgr2=0x7fd39006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd39006ace0 0x7fd39006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd39c000fb0 tx=0x7fd39c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:49.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 msgr2=0x7fd3ac0c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 0x7fd3ac0c4430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4014040 tx=0x7fd3a4004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 shutdown_connections 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd39006ace0 0x7fd39006d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3ac15d780 0x7fd3ac0c4430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3ac0caf70 0x7fd3ac14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 --2- 172.21.15.26:0/1584180186 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3ac0ccc90 0x7fd3ac0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 >> 172.21.15.26:0/1584180186 conn(0x7fd3ac089fc0 msgr2=0x7fd3ac0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 shutdown_connections 2023-06-09T04:38:49.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:49.823+0000 7fd3b3996700 1 -- 172.21.15.26:0/1584180186 wait complete. 2023-06-09T04:38:49.826 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:38:49.836 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:38:49.836 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:49.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:50.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.016+0000 7f8c83580700 1 Processor -- start 2023-06-09T04:38:50.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.017+0000 7f8c83580700 1 -- start start 2023-06-09T04:38:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.017+0000 7f8c83580700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8c7c0cebc0 0x7f8c7c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c83580700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c7c0b0140 0x7f8c7c0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c83580700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c0d08b0 con 0x7f8c7c15a340 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c83580700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c15a710 con 0x7f8c7c0b0140 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c83580700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b0a80 con 0x7f8c7c0cebc0 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c7c0b0140 0x7f8c7c0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8c7c0b0140 0x7f8c7c0b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38890/0 (socket says 172.21.15.26:38890) 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 -- 172.21.15.26:0/728510647 learned_addr learned my addr 172.21.15.26:0/728510647 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c80b1b700 1 --2- 172.21.15.26:0/728510647 >> v2:172.21.15.104:3300/0 conn(0x7f8c7c0cebc0 0x7f8c7c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 -- 172.21.15.26:0/728510647 >> v2:172.21.15.104:3300/0 conn(0x7f8c7c0cebc0 msgr2=0x7f8c7c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 --2- 172.21.15.26:0/728510647 >> v2:172.21.15.104:3300/0 conn(0x7f8c7c0cebc0 0x7f8c7c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 -- 172.21.15.26:0/728510647 >> v1:172.21.15.104:6789/0 conn(0x7f8c7c15a340 legacy=0x7f8c7c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 -- 172.21.15.26:0/728510647 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0b0d20 con 0x7f8c7c0b0140 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c81b1d700 1 --2- 172.21.15.26:0/728510647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c0b0540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c071640 tx=0x7f8c7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9ff5b860fd3f81 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c6ffff700 1 -- 172.21.15.26:0/728510647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400e070 con 0x7f8c7c0b0140 2023-06-09T04:38:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c6ffff700 1 -- 172.21.15.26:0/728510647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74003a20 con 0x7f8c7c0b0140 2023-06-09T04:38:50.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.018+0000 7f8c6ffff700 1 -- 172.21.15.26:0/728510647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74003dd0 con 0x7f8c7c0b0140 2023-06-09T04:38:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 -- 172.21.15.26:0/728510647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 msgr2=0x7f8c7c0b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 --2- 172.21.15.26:0/728510647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c0b0540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c071640 tx=0x7f8c7400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 -- 172.21.15.26:0/728510647 shutdown_connections 2023-06-09T04:38:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 --2- 172.21.15.26:0/728510647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c0b0540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 --2- 172.21.15.26:0/728510647 >> v2:172.21.15.104:3300/0 conn(0x7f8c7c0cebc0 0x7f8c7c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 -- 172.21.15.26:0/728510647 >> 172.21.15.26:0/728510647 conn(0x7f8c7c089fc0 msgr2=0x7f8c7c08a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 -- 172.21.15.26:0/728510647 shutdown_connections 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.019+0000 7f8c83580700 1 -- 172.21.15.26:0/728510647 wait complete. 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.020+0000 7f8c83580700 1 Processor -- start 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.020+0000 7f8c83580700 1 -- start start 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c83580700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c83580700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c7c0cebc0 0x7f8c7c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c83580700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c7c15a340 0x7f8c7c0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c83580700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c14e290 con 0x7f8c7c0b0140 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c83580700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0c4740 con 0x7f8c7c15a340 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c83580700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0c4a20 con 0x7f8c7c0cebc0 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c8131c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c8131c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38892/0 (socket says 172.21.15.26:38892) 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c8131c700 1 -- 172.21.15.26:0/3468862957 learned_addr learned my addr 172.21.15.26:0/3468862957 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c80b1b700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c7c0cebc0 0x7f8c7c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.021+0000 7f8c81b1d700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c7c15a340 0x7f8c7c0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c8131c700 1 -- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c7c0cebc0 msgr2=0x7f8c7c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c8131c700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c7c0cebc0 0x7f8c7c14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c8131c700 1 -- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c7c15a340 msgr2=0x7f8c7c0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c8131c700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c7c15a340 0x7f8c7c0c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c8131c700 1 -- 172.21.15.26:0/3468862957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c74009b30 con 0x7f8c7c0b0140 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c8131c700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c154430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b450 tx=0x7f8c7800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78004020 con 0x7f8c7c0b0140 2023-06-09T04:38:50.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78004180 con 0x7f8c7c0b0140 2023-06-09T04:38:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c0c4d00 con 0x7f8c7c0b0140 2023-06-09T04:38:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78004530 con 0x7f8c7c0b0140 2023-06-09T04:38:50.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.022+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c0c52c0 con 0x7f8c7c0b0140 2023-06-09T04:38:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.023+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c0d1210 con 0x7f8c7c0b0140 2023-06-09T04:38:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.023+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c780036d0 con 0x7f8c7c0b0140 2023-06-09T04:38:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.024+0000 7f8c6dffb700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c6006ace0 0x7f8c6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.024+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c78088c70 con 0x7f8c7c0b0140 2023-06-09T04:38:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.024+0000 7f8c80b1b700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c6006ace0 0x7f8c6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.024+0000 7f8c80b1b700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c6006ace0 0x7f8c6006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1f2ef0 tx=0x7f8c70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.028+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c78053db0 con 0x7f8c7c0b0140 2023-06-09T04:38:50.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.230+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c7c0af480 con 0x7f8c7c0b0140 2023-06-09T04:38:50.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.231+0000 7f8c6dffb700 1 -- 172.21.15.26:0/3468862957 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f8c78015090 con 0x7f8c7c0b0140 2023-06-09T04:38:50.232 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:50.232 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:50.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c6006ace0 msgr2=0x7f8c6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c6006ace0 0x7f8c6006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1f2ef0 tx=0x7f8c70008040 comp rx=0 tx=0).stop 2023-06-09T04:38:50.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 msgr2=0x7f8c7c154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c154430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b450 tx=0x7f8c7800b810 comp rx=0 tx=0).stop 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 shutdown_connections 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c7c15a340 0x7f8c7c0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f8c6006ace0 0x7f8c6006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c7c0b0140 0x7f8c7c154430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 --2- 172.21.15.26:0/3468862957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c7c0cebc0 0x7f8c7c14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 >> 172.21.15.26:0/3468862957 conn(0x7f8c7c089fc0 msgr2=0x7f8c7c0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:50.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 shutdown_connections 2023-06-09T04:38:50.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.233+0000 7f8c83580700 1 -- 172.21.15.26:0/3468862957 wait complete. 2023-06-09T04:38:50.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:50.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:50.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.373+0000 7fbb91935700 1 Processor -- start 2023-06-09T04:38:50.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.373+0000 7fbb91935700 1 -- start start 2023-06-09T04:38:50.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.374+0000 7fbb91935700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbb8c0aed50 0x7fbb8c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.374+0000 7fbb91935700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c06f190 con 0x7fbb8c06e990 2023-06-09T04:38:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.374+0000 7fbb91935700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c06e440 con 0x7fbb8c15c6e0 2023-06-09T04:38:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.374+0000 7fbb91935700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c06e690 con 0x7fbb8c0aed50 2023-06-09T04:38:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.374+0000 7fbb8b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbb8c06e990 0x7fbb8c06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47762/0 (socket says 172.21.15.26:47762) 2023-06-09T04:38:50.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.374+0000 7fbb8b7fe700 1 -- 172.21.15.26:0/3734628315 learned_addr learned my addr 172.21.15.26:0/3734628315 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb8a7fc700 1 --2- 172.21.15.26:0/3734628315 >> v2:172.21.15.104:3300/0 conn(0x7fbb8c0aed50 0x7fbb8c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157634928 0 0) 0x7fbb8c06f190 con 0x7fbb8c06e990 2023-06-09T04:38:50.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb780035b0 con 0x7fbb8c06e990 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 824571945 0 0) 0x7fbb780035b0 con 0x7fbb8c06e990 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 >> v2:172.21.15.104:3300/0 conn(0x7fbb8c0aed50 msgr2=0x7fbb8c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 --2- 172.21.15.26:0/3734628315 >> v2:172.21.15.104:3300/0 conn(0x7fbb8c0aed50 0x7fbb8c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 >> v1:172.21.15.104:6789/0 conn(0x7fbb8c15c6e0 legacy=0x7fbb8c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c160300 con 0x7fbb8c06e990 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fbb840019f0 con 0x7fbb8c06e990 2023-06-09T04:38:50.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb8a7fc700 1 --2- 172.21.15.26:0/3734628315 >> v2:172.21.15.104:3300/0 conn(0x7fbb8c0aed50 0x7fbb8c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 >> v1:172.21.15.26:6789/0 conn(0x7fbb8c06e990 legacy=0x7fbb8c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb78003a00 0x7fbb78003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78004850 0x7fbb78004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb78005200 0x7fbb7800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c06e690 con 0x7fbb78003a00 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800c110 con 0x7fbb78005200 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800c2d0 con 0x7fbb78004850 2023-06-09T04:38:50.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb8affd700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb78003a00 0x7fbb78003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb8a7fc700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78004850 0x7fbb78004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.375+0000 7fbb8b7fe700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb78005200 0x7fbb7800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8affd700 1 -- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78004850 msgr2=0x7fbb78004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8affd700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78004850 0x7fbb78004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8affd700 1 -- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb78005200 msgr2=0x7fbb7800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8affd700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb78005200 0x7fbb7800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8affd700 1 -- 172.21.15.26:0/3734628315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780035b0 con 0x7fbb78003a00 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8b7fe700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb78005200 0x7fbb7800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8b7fe700 1 -- 172.21.15.26:0/3734628315 reap_dead start 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb8affd700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb78003a00 0x7fbb78003e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001860 tx=0x7fbb78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5e712c53389431 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74001320 con 0x7fbb78003a00 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74005310 con 0x7fbb78003a00 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb89ffb700 1 -- 172.21.15.26:0/3734628315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740068b0 con 0x7fbb78003a00 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 -- 172.21.15.26:0/3734628315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb78003a00 msgr2=0x7fbb78003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb78003a00 0x7fbb78003e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001860 tx=0x7fbb78005880 comp rx=0 tx=0).stop 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 -- 172.21.15.26:0/3734628315 shutdown_connections 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 --2- 172.21.15.26:0/3734628315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb78003a00 0x7fbb78003e10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 -- 172.21.15.26:0/3734628315 >> 172.21.15.26:0/3734628315 conn(0x7fbb8c098a30 msgr2=0x7fbb8c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 -- 172.21.15.26:0/3734628315 shutdown_connections 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.376+0000 7fbb91935700 1 -- 172.21.15.26:0/3734628315 wait complete. 2023-06-09T04:38:50.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.378+0000 7fbb91935700 1 Processor -- start 2023-06-09T04:38:50.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.378+0000 7fbb91935700 1 -- start start 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78003a00 0x7fbb8c1f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8c0b4d20 0x7fbb8c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 0x7fbb8c157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c1575c0 con 0x7fbb8c156c10 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0af3d0 con 0x7fbb8c0b4d20 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0aff30 con 0x7fbb78003a00 2023-06-09T04:38:50.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 0x7fbb8c157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 0x7fbb8c157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38916/0 (socket says 172.21.15.26:38916) 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 -- 172.21.15.26:0/1933141609 learned_addr learned my addr 172.21.15.26:0/1933141609 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8a7fc700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8c0b4d20 0x7fbb8c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8affd700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78003a00 0x7fbb8c1f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 -- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78003a00 msgr2=0x7fbb8c1f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78003a00 0x7fbb8c1f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 -- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8c0b4d20 msgr2=0x7fbb8c0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8c0b4d20 0x7fbb8c0b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 -- 172.21.15.26:0/1933141609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0af600 con 0x7fbb8c156c10 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8affd700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78003a00 0x7fbb8c1f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb8b7fe700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 0x7fbb8c157080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c06edf0 tx=0x7fbb84007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84017070 con 0x7fbb8c156c10 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8400ec30 con 0x7fbb8c156c10 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400ede0 con 0x7fbb8c156c10 2023-06-09T04:38:50.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c0af8e0 con 0x7fbb8c156c10 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.379+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c0b2810 con 0x7fbb8c156c10 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.380+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c067180 con 0x7fbb8c156c10 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.381+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb84013420 con 0x7fbb8c156c10 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.381+0000 7fbb83fff700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb6c06ace0 0x7fbb6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.381+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb84089170 con 0x7fbb8c156c10 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.381+0000 7fbb8affd700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb6c06ace0 0x7fbb6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.382+0000 7fbb8affd700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb6c06ace0 0x7fbb6c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001860 tx=0x7fbb74009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.386+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb84054220 con 0x7fbb8c156c10 2023-06-09T04:38:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.585+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb8c0b0070 con 0x7fbb8c156c10 2023-06-09T04:38:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.586+0000 7fbb83fff700 1 -- 172.21.15.26:0/1933141609 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb84057840 con 0x7fbb8c156c10 2023-06-09T04:38:50.587 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb6c06ace0 msgr2=0x7fbb6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb6c06ace0 0x7fbb6c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001860 tx=0x7fbb74009030 comp rx=0 tx=0).stop 2023-06-09T04:38:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 msgr2=0x7fbb8c157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 0x7fbb8c157080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c06edf0 tx=0x7fbb84007c90 comp rx=0 tx=0).stop 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 shutdown_connections 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb6c06ace0 0x7fbb6c06d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c156c10 0x7fbb8c157080 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb78003a00 0x7fbb8c1f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 --2- 172.21.15.26:0/1933141609 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8c0b4d20 0x7fbb8c0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 >> 172.21.15.26:0/1933141609 conn(0x7fbb8c098a30 msgr2=0x7fbb8c0ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 shutdown_connections 2023-06-09T04:38:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.588+0000 7fbb91935700 1 -- 172.21.15.26:0/1933141609 wait complete. 2023-06-09T04:38:50.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.728+0000 7f116ef63700 1 Processor -- start 2023-06-09T04:38:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.728+0000 7f116ef63700 1 -- start start 2023-06-09T04:38:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.728+0000 7f116ef63700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 0x7f11680addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.728+0000 7f116ef63700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116806abd0 con 0x7f116815c6e0 2023-06-09T04:38:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.728+0000 7f116ef63700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680ae7f0 con 0x7f116815c310 2023-06-09T04:38:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.728+0000 7f116ef63700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680aead0 con 0x7f11680cf020 2023-06-09T04:38:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f1167fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f116815c6e0 0x7f116806a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47780/0 (socket says 172.21.15.26:47780) 2023-06-09T04:38:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f1167fff700 1 -- 172.21.15.26:0/1353266993 learned_addr learned my addr 172.21.15.26:0/1353266993 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f116d500700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 0x7f11680addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085498234 0 0) 0x7f116806abd0 con 0x7f116815c6e0 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11580035b0 con 0x7f116815c6e0 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050348054 0 0) 0x7f11680ae7f0 con 0x7f116815c310 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f116806abd0 con 0x7f116815c310 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080804385 0 0) 0x7f11580035b0 con 0x7f116815c6e0 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 msgr2=0x7f11680addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 0x7f11680addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 >> v1:172.21.15.104:6789/0 conn(0x7f116815c310 legacy=0x7f1168069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680cd550 con 0x7f116815c6e0 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f11540015f0 con 0x7f116815c6e0 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 >> v1:172.21.15.26:6789/0 conn(0x7f116815c6e0 legacy=0x7f116806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1158003bc0 0x7f1158003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158004850 0x7f1158004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 0x7f1158005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680aead0 con 0x7f1158003bc0 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115800bbf0 con 0x7f1158004850 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115800bdb0 con 0x7f11680cf020 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f116ccff700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1158003bc0 0x7f1158003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f1167fff700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158004850 0x7f1158004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.729+0000 7f116d500700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 0x7f1158005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ccff700 1 -- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 msgr2=0x7f1158005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ccff700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11680cf020 0x7f1158005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ccff700 1 -- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158004850 msgr2=0x7f1158004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ccff700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158004850 0x7f1158004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ccff700 1 -- 172.21.15.26:0/1353266993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580035b0 con 0x7f1158003bc0 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f1167fff700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158004850 0x7f1158004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ccff700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1158003bc0 0x7f1158003fb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f115c0019a0 tx=0x7f1158005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cba85c6e09bf1d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c001dd0 con 0x7f1158003bc0 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c0052d0 con 0x7f1158003bc0 2023-06-09T04:38:50.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f11677fe700 1 -- 172.21.15.26:0/1353266993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c001460 con 0x7f1158003bc0 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ef63700 1 -- 172.21.15.26:0/1353266993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1158003bc0 msgr2=0x7f1158003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.730+0000 7f116ef63700 1 --2- 172.21.15.26:0/1353266993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1158003bc0 0x7f1158003fb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f115c0019a0 tx=0x7f1158005880 comp rx=0 tx=0).stop 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.731+0000 7f116d500700 1 -- 172.21.15.26:0/1353266993 reap_dead start 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.731+0000 7f116ef63700 1 -- 172.21.15.26:0/1353266993 shutdown_connections 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.731+0000 7f116ef63700 1 -- 172.21.15.26:0/1353266993 >> 172.21.15.26:0/1353266993 conn(0x7f1168098b50 msgr2=0x7f11680cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.731+0000 7f116ef63700 1 -- 172.21.15.26:0/1353266993 shutdown_connections 2023-06-09T04:38:50.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.731+0000 7f116ef63700 1 -- 172.21.15.26:0/1353266993 wait complete. 2023-06-09T04:38:50.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.732+0000 7f116ef63700 1 Processor -- start 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.732+0000 7f116ef63700 1 -- start start 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ef63700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158003bc0 0x7f1168154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ef63700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11681e3a90 0x7f116815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ef63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 0x7f11680ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ef63700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168155310 con 0x7f11680acfe0 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ef63700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680ad9c0 con 0x7f1158003bc0 2023-06-09T04:38:50.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ef63700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116815afe0 con 0x7f11681e3a90 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 0x7f11680ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 0x7f11680ad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38936/0 (socket says 172.21.15.26:38936) 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 -- 172.21.15.26:0/3662781515 learned_addr learned my addr 172.21.15.26:0/3662781515 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ccff700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158003bc0 0x7f1168154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f1167fff700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11681e3a90 0x7f116815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 -- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11681e3a90 msgr2=0x7f116815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11681e3a90 0x7f116815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 -- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158003bc0 msgr2=0x7f1168154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158003bc0 0x7f1168154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 -- 172.21.15.26:0/3662781515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11681e5260 con 0x7f11680acfe0 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116ccff700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158003bc0 0x7f1168154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f116d500700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 0x7f11680ad480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f11580047d0 tx=0x7f116000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.733+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000e040 con 0x7f11680acfe0 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.734+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000f040 con 0x7f11680acfe0 2023-06-09T04:38:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.734+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11681e4530 con 0x7f11680acfe0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.734+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160015670 con 0x7f11680acfe0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.734+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681e4780 con 0x7f11680acfe0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.734+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116815b4f0 con 0x7f11680acfe0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.735+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11600157d0 con 0x7f11680acfe0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.735+0000 7f11657fa700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f114c06ace0 0x7f114c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.735+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1160089a90 con 0x7f11680acfe0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.736+0000 7f116ccff700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f114c06ace0 0x7f114c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:50.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.736+0000 7f116ccff700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f114c06ace0 0x7f114c06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11681e6a90 tx=0x7f115c00a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.740+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1160054b40 con 0x7f11680acfe0 2023-06-09T04:38:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.939+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11680add50 con 0x7f11680acfe0 2023-06-09T04:38:50.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.939+0000 7f11657fa700 1 -- 172.21.15.26:0/3662781515 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1160058160 con 0x7f11680acfe0 2023-06-09T04:38:50.941 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:50.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f114c06ace0 msgr2=0x7f114c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f114c06ace0 0x7f114c06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11681e6a90 tx=0x7f115c00a000 comp rx=0 tx=0).stop 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 msgr2=0x7f11680ad480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 0x7f11680ad480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f11580047d0 tx=0x7f116000f490 comp rx=0 tx=0).stop 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 shutdown_connections 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f114c06ace0 0x7f114c06d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11680acfe0 0x7f11680ad480 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1158003bc0 0x7f1168154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 --2- 172.21.15.26:0/3662781515 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11681e3a90 0x7f116815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 >> 172.21.15.26:0/3662781515 conn(0x7f1168098b50 msgr2=0x7f116806e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 shutdown_connections 2023-06-09T04:38:50.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:50.941+0000 7f116ef63700 1 -- 172.21.15.26:0/3662781515 wait complete. 2023-06-09T04:38:50.954 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:51.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.081+0000 7f1982b66700 1 Processor -- start 2023-06-09T04:38:51.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.081+0000 7f1982b66700 1 -- start start 2023-06-09T04:38:51.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1982b66700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f197c15c6e0 0x7f197c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1982b66700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c098e30 0x7f197c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1982b66700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c06f190 con 0x7f197c06e990 2023-06-09T04:38:51.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1982b66700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c06e440 con 0x7f197c15c6e0 2023-06-09T04:38:51.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1982b66700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c06e690 con 0x7f197c098e30 2023-06-09T04:38:51.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1980902700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f197c15c6e0 0x7f197c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f197bfff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f197c06e990 0x7f197c0cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:46712/0 (socket says 172.21.15.26:46712) 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f197bfff700 1 -- 172.21.15.26:0/3305018032 learned_addr learned my addr 172.21.15.26:0/3305018032 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.082+0000 7f1981103700 1 --2- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c098e30 0x7f197c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f197b7fe700 1 -- 172.21.15.26:0/3305018032 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629334937 0 0) 0x7f197c06f190 con 0x7f197c06e990 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f197b7fe700 1 -- 172.21.15.26:0/3305018032 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f196c0035b0 con 0x7f197c06e990 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f1980902700 1 -- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c098e30 msgr2=0x7f197c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f1980902700 1 --2- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c098e30 0x7f197c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f1980902700 1 -- 172.21.15.26:0/3305018032 >> v1:172.21.15.104:6789/0 conn(0x7f197c06e990 legacy=0x7f197c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f1980902700 1 -- 172.21.15.26:0/3305018032 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c160300 con 0x7f197c15c6e0 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f1980902700 1 --2- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c0ae640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1970009820 tx=0x7f1970009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be373cfbc02f6526 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f197b7fe700 1 -- 172.21.15.26:0/3305018032 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970005e30 con 0x7f197c15c6e0 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f197b7fe700 1 -- 172.21.15.26:0/3305018032 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970006030 con 0x7f197c15c6e0 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.083+0000 7f197b7fe700 1 -- 172.21.15.26:0/3305018032 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700063c0 con 0x7f197c15c6e0 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 -- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 msgr2=0x7f197c0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 --2- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c0ae640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1970009820 tx=0x7f1970009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 -- 172.21.15.26:0/3305018032 shutdown_connections 2023-06-09T04:38:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 --2- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c098e30 0x7f197c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 --2- 172.21.15.26:0/3305018032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c0ae640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 -- 172.21.15.26:0/3305018032 >> 172.21.15.26:0/3305018032 conn(0x7f197c098a30 msgr2=0x7f197c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 -- 172.21.15.26:0/3305018032 shutdown_connections 2023-06-09T04:38:51.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.084+0000 7f1982b66700 1 -- 172.21.15.26:0/3305018032 wait complete. 2023-06-09T04:38:51.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.085+0000 7f1982b66700 1 Processor -- start 2023-06-09T04:38:51.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.086+0000 7f1982b66700 1 -- start start 2023-06-09T04:38:51.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c06e990 0x7f197c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 0x7f197c158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c159980 con 0x7f197c098e30 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0b0f60 con 0x7f197c15c6e0 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c156270 con 0x7f197c06e990 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 0x7f197c158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 0x7f197c158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38948/0 (socket says 172.21.15.26:38948) 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 -- 172.21.15.26:0/2671268647 learned_addr learned my addr 172.21.15.26:0/2671268647 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:51.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1980902700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c06e990 0x7f197c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1981103700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 -- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c06e990 msgr2=0x7f197c155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c06e990 0x7f197c155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 -- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 msgr2=0x7f197c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 -- 172.21.15.26:0/2671268647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970009430 con 0x7f197c098e30 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1980902700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c06e990 0x7f197c155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:51.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f197bfff700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 0x7f197c158160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f196800c420 tx=0x7f196800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968005d70 con 0x7f197c098e30 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19680070d0 con 0x7f197c098e30 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c158d00 con 0x7f197c098e30 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.087+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968007440 con 0x7f197c098e30 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.088+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c1592c0 con 0x7f197c098e30 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.088+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c159ac0 con 0x7f197c098e30 2023-06-09T04:38:51.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.089+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19680075a0 con 0x7f197c098e30 2023-06-09T04:38:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.089+0000 7f19797fa700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f196006ace0 0x7f196006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.089+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1968088750 con 0x7f197c098e30 2023-06-09T04:38:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.090+0000 7f1980902700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f196006ace0 0x7f196006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.090+0000 7f1980902700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f196006ace0 0x7f196006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1970013040 tx=0x7f1970008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.094+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f197c159ac0 con 0x7f197c098e30 2023-06-09T04:38:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.290+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f197c159ac0 con 0x7f197c098e30 2023-06-09T04:38:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.290+0000 7f19797fa700 1 -- 172.21.15.26:0/2671268647 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f197c159ac0 con 0x7f197c098e30 2023-06-09T04:38:51.292 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f196006ace0 msgr2=0x7f196006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f196006ace0 0x7f196006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1970013040 tx=0x7f1970008070 comp rx=0 tx=0).stop 2023-06-09T04:38:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 msgr2=0x7f197c158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 0x7f197c158160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f196800c420 tx=0x7f196800c7e0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 shutdown_connections 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c15c6e0 0x7f197c1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f197c06e990 0x7f197c155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f196006ace0 0x7f196006d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 --2- 172.21.15.26:0/2671268647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f197c098e30 0x7f197c158160 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 >> 172.21.15.26:0/2671268647 conn(0x7f197c098a30 msgr2=0x7f197c0ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 shutdown_connections 2023-06-09T04:38:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.293+0000 7f1982b66700 1 -- 172.21.15.26:0/2671268647 wait complete. 2023-06-09T04:38:51.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.433+0000 7fe53cd73700 1 Processor -- start 2023-06-09T04:38:51.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.433+0000 7fe53cd73700 1 -- start start 2023-06-09T04:38:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53cd73700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe5380ce330 0x7fe538164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53cd73700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53806b480 con 0x7fe538159ee0 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53cd73700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53806a200 con 0x7fe53815a2b0 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53cd73700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53806ae80 con 0x7fe5380ce330 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe538159ee0 0x7fe53815e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47812/0 (socket says 172.21.15.26:47812) 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53659c700 1 -- 172.21.15.26:0/1440318194 learned_addr learned my addr 172.21.15.26:0/1440318194 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe536d9d700 1 --2- 172.21.15.26:0/1440318194 >> v2:172.21.15.104:3300/0 conn(0x7fe5380ce330 0x7fe538164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.434+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074062054 0 0) 0x7fe53806b480 con 0x7fe538159ee0 2023-06-09T04:38:51.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5200035b0 con 0x7fe538159ee0 2023-06-09T04:38:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954554941 0 0) 0x7fe5200035b0 con 0x7fe538159ee0 2023-06-09T04:38:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 >> v2:172.21.15.104:3300/0 conn(0x7fe5380ce330 msgr2=0x7fe538164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 --2- 172.21.15.26:0/1440318194 >> v2:172.21.15.104:3300/0 conn(0x7fe5380ce330 0x7fe538164fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 >> v1:172.21.15.104:6789/0 conn(0x7fe53815a2b0 legacy=0x7fe5380cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53806a4e0 con 0x7fe538159ee0 2023-06-09T04:38:51.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fe52c001670 con 0x7fe538159ee0 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 >> v1:172.21.15.26:6789/0 conn(0x7fe538159ee0 legacy=0x7fe53815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe520003a00 0x7fe520003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe520004850 0x7fe520004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520005320 0x7fe52000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53806ae80 con 0x7fe520003a00 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52000c250 con 0x7fe520004850 2023-06-09T04:38:51.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52000c410 con 0x7fe520005320 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe520003a00 0x7fe520003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe535d9b700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe520004850 0x7fe520004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe536d9d700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520005320 0x7fe52000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 -- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520005320 msgr2=0x7fe52000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520005320 0x7fe52000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 -- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe520004850 msgr2=0x7fe520004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe520004850 0x7fe520004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 -- 172.21.15.26:0/1440318194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200035b0 con 0x7fe520003a00 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe536d9d700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520005320 0x7fe52000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe536d9d700 1 -- 172.21.15.26:0/1440318194 reap_dead start 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.435+0000 7fe53659c700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe520003a00 0x7fe520003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00c240 tx=0x7fe520005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f2e48077279f1d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c007c10 con 0x7fe520003a00 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00cde0 con 0x7fe520003a00 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53559a700 1 -- 172.21.15.26:0/1440318194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c005ba0 con 0x7fe520003a00 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 -- 172.21.15.26:0/1440318194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe520003a00 msgr2=0x7fe520003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe520003a00 0x7fe520003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00c240 tx=0x7fe520005880 comp rx=0 tx=0).stop 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 -- 172.21.15.26:0/1440318194 shutdown_connections 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 --2- 172.21.15.26:0/1440318194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe520003a00 0x7fe520003e10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 -- 172.21.15.26:0/1440318194 >> 172.21.15.26:0/1440318194 conn(0x7fe5380cba20 msgr2=0x7fe5380cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 -- 172.21.15.26:0/1440318194 shutdown_connections 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.436+0000 7fe53cd73700 1 -- 172.21.15.26:0/1440318194 wait complete. 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 Processor -- start 2023-06-09T04:38:51.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 -- start start 2023-06-09T04:38:51.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520003a00 0x7fe53814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 0x7fe5380ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5380c4a20 0x7fe5380c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380c53d0 con 0x7fe5380b1550 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380aef10 con 0x7fe5380c4a20 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.438+0000 7fe53cd73700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380ae480 con 0x7fe520003a00 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 0x7fe5380ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 0x7fe5380ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38968/0 (socket says 172.21.15.26:38968) 2023-06-09T04:38:51.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 -- 172.21.15.26:0/612318571 learned_addr learned my addr 172.21.15.26:0/612318571 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe536d9d700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5380c4a20 0x7fe5380c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe53659c700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520003a00 0x7fe53814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 -- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520003a00 msgr2=0x7fe53814bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520003a00 0x7fe53814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 -- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5380c4a20 msgr2=0x7fe5380c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5380c4a20 0x7fe5380c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 -- 172.21.15.26:0/612318571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380b19c0 con 0x7fe5380b1550 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe536d9d700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5380c4a20 0x7fe5380c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe535d9b700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 0x7fe5380ae9d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe52800f5c0 tx=0x7fe52800f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280053e0 con 0x7fe5380b1550 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528005540 con 0x7fe5380b1550 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5380af140 con 0x7fe5380b1550 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528006a80 con 0x7fe5380b1550 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.439+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5380af700 con 0x7fe5380b1550 2023-06-09T04:38:51.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.440+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380cebd0 con 0x7fe5380b1550 2023-06-09T04:38:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.441+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe528006be0 con 0x7fe5380b1550 2023-06-09T04:38:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.441+0000 7fe526ffd700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe51806ace0 0x7fe51806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.441+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe528088c60 con 0x7fe5380b1550 2023-06-09T04:38:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.441+0000 7fe53659c700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe51806ace0 0x7fe51806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.442+0000 7fe53659c700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe51806ace0 0x7fe51806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe52c015040 tx=0x7fe52c007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.445+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe528053d10 con 0x7fe5380b1550 2023-06-09T04:38:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.642+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe538074080 con 0x7fe5380b1550 2023-06-09T04:38:51.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.643+0000 7fe526ffd700 1 -- 172.21.15.26:0/612318571 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe52801a020 con 0x7fe5380b1550 2023-06-09T04:38:51.644 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:51.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe51806ace0 msgr2=0x7fe51806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe51806ace0 0x7fe51806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe52c015040 tx=0x7fe52c007000 comp rx=0 tx=0).stop 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 msgr2=0x7fe5380ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 0x7fe5380ae9d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe52800f5c0 tx=0x7fe52800f980 comp rx=0 tx=0).stop 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 shutdown_connections 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5380c4a20 0x7fe5380c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe520003a00 0x7fe53814bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe51806ace0 0x7fe51806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 --2- 172.21.15.26:0/612318571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5380b1550 0x7fe5380ae9d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 >> 172.21.15.26:0/612318571 conn(0x7fe5380cba20 msgr2=0x7fe5380c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 shutdown_connections 2023-06-09T04:38:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.645+0000 7fe53cd73700 1 -- 172.21.15.26:0/612318571 wait complete. 2023-06-09T04:38:51.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:51.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.782+0000 7f431b8c8700 1 Processor -- start 2023-06-09T04:38:51.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.782+0000 7f431b8c8700 1 -- start start 2023-06-09T04:38:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.783+0000 7f431b8c8700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f43140aed90 0x7f43140c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.783+0000 7f431b8c8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4314159880 con 0x7f43140ca370 2023-06-09T04:38:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.783+0000 7f431b8c8700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431406cff0 con 0x7f43140cecb0 2023-06-09T04:38:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.783+0000 7f431b8c8700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43140ca810 con 0x7f43140aed90 2023-06-09T04:38:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.783+0000 7f4318e63700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f43140ca370 0x7f43140ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47836/0 (socket says 172.21.15.26:47836) 2023-06-09T04:38:51.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.783+0000 7f4318e63700 1 -- 172.21.15.26:0/3238470700 learned_addr learned my addr 172.21.15.26:0/3238470700 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f4319664700 1 --2- 172.21.15.26:0/3238470700 >> v2:172.21.15.104:3300/0 conn(0x7f43140aed90 0x7f43140c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439682480 0 0) 0x7f4314159880 con 0x7f43140ca370 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43000057c0 con 0x7f43140ca370 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955334085 0 0) 0x7f431406cff0 con 0x7f43140cecb0 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4314159880 con 0x7f43140cecb0 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707660920 0 0) 0x7f43000057c0 con 0x7f43140ca370 2023-06-09T04:38:51.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f4319664700 1 -- 172.21.15.26:0/3238470700 >> v1:172.21.15.104:6789/0 conn(0x7f43140cecb0 legacy=0x7f431406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f4319664700 1 -- 172.21.15.26:0/3238470700 >> v1:172.21.15.26:6789/0 conn(0x7f43140ca370 legacy=0x7f43140ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f4319664700 1 -- 172.21.15.26:0/3238470700 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43140cf250 con 0x7f43140aed90 2023-06-09T04:38:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f4319664700 1 --2- 172.21.15.26:0/3238470700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140aed90 0x7f43140c9e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4304009820 tx=0x7f4304009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf5f516318629ff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310001670 con 0x7f43140aed90 2023-06-09T04:38:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4304005c30 con 0x7f43140aed90 2023-06-09T04:38:51.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.784+0000 7f430bfff700 1 -- 172.21.15.26:0/3238470700 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304004030 con 0x7f43140aed90 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 -- 172.21.15.26:0/3238470700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140aed90 msgr2=0x7f43140c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 --2- 172.21.15.26:0/3238470700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140aed90 0x7f43140c9e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4304009820 tx=0x7f4304009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 -- 172.21.15.26:0/3238470700 shutdown_connections 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 --2- 172.21.15.26:0/3238470700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140aed90 0x7f43140c9e30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 -- 172.21.15.26:0/3238470700 >> 172.21.15.26:0/3238470700 conn(0x7f4314098a30 msgr2=0x7f43140cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 -- 172.21.15.26:0/3238470700 shutdown_connections 2023-06-09T04:38:51.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.785+0000 7f431b8c8700 1 -- 172.21.15.26:0/3238470700 wait complete. 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.786+0000 7f431b8c8700 1 Processor -- start 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.786+0000 7f431b8c8700 1 -- start start 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f431b8c8700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43140aed90 0x7f4314150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f431b8c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 0x7f43140ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f431b8c8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140cecb0 0x7f43140b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f431b8c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b5270 con 0x7f43140ca370 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f431b8c8700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4314151220 con 0x7f43140cecb0 2023-06-09T04:38:51.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f431b8c8700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b4660 con 0x7f43140aed90 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 0x7f43140ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 0x7f43140ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38982/0 (socket says 172.21.15.26:38982) 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 -- 172.21.15.26:0/770076820 learned_addr learned my addr 172.21.15.26:0/770076820 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4319e65700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140cecb0 0x7f43140b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4319664700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43140aed90 0x7f4314150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 -- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43140aed90 msgr2=0x7f4314150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43140aed90 0x7f4314150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 -- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140cecb0 msgr2=0x7f43140b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140cecb0 0x7f43140b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4318e63700 1 -- 172.21.15.26:0/770076820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304009430 con 0x7f43140ca370 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.787+0000 7f4319664700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43140aed90 0x7f4314150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.788+0000 7f4318e63700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 0x7f43140ac640 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f431000c4d0 tx=0x7f431000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.788+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310004c80 con 0x7f43140ca370 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.788+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310004e00 con 0x7f43140ca370 2023-06-09T04:38:51.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.788+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43140b4940 con 0x7f43140ca370 2023-06-09T04:38:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.788+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310007310 con 0x7f43140ca370 2023-06-09T04:38:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.788+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43140b4f00 con 0x7f43140ca370 2023-06-09T04:38:51.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.789+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4314067180 con 0x7f43140ca370 2023-06-09T04:38:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.789+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4310007470 con 0x7f43140ca370 2023-06-09T04:38:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.790+0000 7f4309ffb700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f42f806ace0 0x7f42f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.790+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43100891a0 con 0x7f43140ca370 2023-06-09T04:38:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.790+0000 7f4319664700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f42f806ace0 0x7f42f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:51.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.790+0000 7f4319664700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f42f806ace0 0x7f42f806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4304000c00 tx=0x7f4304008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:51.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:51.794+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4310054250 con 0x7f43140ca370 2023-06-09T04:38:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.009+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f43140b53b0 con 0x7f43140ca370 2023-06-09T04:38:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.009+0000 7f4309ffb700 1 -- 172.21.15.26:0/770076820 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4310057870 con 0x7f43140ca370 2023-06-09T04:38:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f42f806ace0 msgr2=0x7f42f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f42f806ace0 0x7f42f806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4304000c00 tx=0x7f4304008070 comp rx=0 tx=0).stop 2023-06-09T04:38:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 msgr2=0x7f43140ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 0x7f43140ac640 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f431000c4d0 tx=0x7f431000c7e0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 shutdown_connections 2023-06-09T04:38:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43140cecb0 0x7f43140b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f43140aed90 0x7f4314150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f42f806ace0 0x7f42f806d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 --2- 172.21.15.26:0/770076820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43140ca370 0x7f43140ac640 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 >> 172.21.15.26:0/770076820 conn(0x7f4314098a30 msgr2=0x7f43141578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 shutdown_connections 2023-06-09T04:38:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.011+0000 7f431b8c8700 1 -- 172.21.15.26:0/770076820 wait complete. 2023-06-09T04:38:52.016 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:38:52.024 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-06-09T04:38:52.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:52.066 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:52.067 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:38:52.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.068 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T04:38:52.140 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:38:52.141 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:52.163 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:38:52.163 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:52.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.348+0000 7f5f9e901700 1 Processor -- start 2023-06-09T04:38:52.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.348+0000 7f5f9e901700 1 -- start start 2023-06-09T04:38:52.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.349+0000 7f5f9e901700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f980aed50 0x7f5f98069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.349+0000 7f5f9e901700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5f9806e990 0x7f5f9806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.349+0000 7f5f9e901700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9806f190 con 0x7f5f9815c6e0 2023-06-09T04:38:52.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.349+0000 7f5f9e901700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9806e440 con 0x7f5f9806e990 2023-06-09T04:38:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.349+0000 7f5f9e901700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806e690 con 0x7f5f980aed50 2023-06-09T04:38:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f977fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f980aed50 0x7f5f98069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f9ce9e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5f9806e990 0x7f5f9806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f97fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5f9815c6e0 0x7f5f980ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:46758/0 (socket says 172.21.15.26:46758) 2023-06-09T04:38:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f97fff700 1 -- 172.21.15.26:0/3790998959 learned_addr learned my addr 172.21.15.26:0/3790998959 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f96ffd700 1 -- 172.21.15.26:0/3790998959 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228607708 0 0) 0x7f5f9806f190 con 0x7f5f9815c6e0 2023-06-09T04:38:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f977fe700 1 -- 172.21.15.26:0/3790998959 >> v2:172.21.15.104:3300/0 conn(0x7f5f9806e990 msgr2=0x7f5f9806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:52.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f977fe700 1 --2- 172.21.15.26:0/3790998959 >> v2:172.21.15.104:3300/0 conn(0x7f5f9806e990 0x7f5f9806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f977fe700 1 -- 172.21.15.26:0/3790998959 >> v1:172.21.15.104:6789/0 conn(0x7f5f9815c6e0 legacy=0x7f5f980ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f977fe700 1 -- 172.21.15.26:0/3790998959 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98160300 con 0x7f5f980aed50 2023-06-09T04:38:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f977fe700 1 --2- 172.21.15.26:0/3790998959 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f980aed50 0x7f5f98069db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009840 tx=0x7f5f8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=361424b7709d3e50 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f96ffd700 1 -- 172.21.15.26:0/3790998959 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c011830 con 0x7f5f980aed50 2023-06-09T04:38:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f96ffd700 1 -- 172.21.15.26:0/3790998959 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c011990 con 0x7f5f980aed50 2023-06-09T04:38:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.350+0000 7f5f96ffd700 1 -- 172.21.15.26:0/3790998959 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c011d20 con 0x7f5f980aed50 2023-06-09T04:38:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 -- 172.21.15.26:0/3790998959 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f980aed50 msgr2=0x7f5f98069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 --2- 172.21.15.26:0/3790998959 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f980aed50 0x7f5f98069db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009840 tx=0x7f5f8c009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 -- 172.21.15.26:0/3790998959 shutdown_connections 2023-06-09T04:38:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 --2- 172.21.15.26:0/3790998959 >> v2:172.21.15.104:3300/0 conn(0x7f5f9806e990 0x7f5f9806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 --2- 172.21.15.26:0/3790998959 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f980aed50 0x7f5f98069db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 -- 172.21.15.26:0/3790998959 >> 172.21.15.26:0/3790998959 conn(0x7f5f98098a30 msgr2=0x7f5f980cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 -- 172.21.15.26:0/3790998959 shutdown_connections 2023-06-09T04:38:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.351+0000 7f5f9e901700 1 -- 172.21.15.26:0/3790998959 wait complete. 2023-06-09T04:38:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.352+0000 7f5f9e901700 1 Processor -- start 2023-06-09T04:38:52.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.352+0000 7f5f9e901700 1 -- start start 2023-06-09T04:38:52.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9e901700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 0x7f5f981f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9e901700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f980aed50 0x7f5f980c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9e901700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f9815c6e0 0x7f5f9806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9e901700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980c90a0 con 0x7f5f980aed50 2023-06-09T04:38:52.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9e901700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980c8490 con 0x7f5f9806e990 2023-06-09T04:38:52.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9e901700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980c8770 con 0x7f5f9815c6e0 2023-06-09T04:38:52.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f97fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 0x7f5f981f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f980aed50 0x7f5f980c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f97fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 0x7f5f981f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:46114/0 (socket says 172.21.15.26:46114) 2023-06-09T04:38:52.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f97fff700 1 -- 172.21.15.26:0/1169459512 learned_addr learned my addr 172.21.15.26:0/1169459512 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:52.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.353+0000 7f5f9ce9e700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f9815c6e0 0x7f5f9806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9ce9e700 1 -- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 msgr2=0x7f5f981f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9ce9e700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 0x7f5f981f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9ce9e700 1 -- 172.21.15.26:0/1169459512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f980aed50 msgr2=0x7f5f980c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9ce9e700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f980aed50 0x7f5f980c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9ce9e700 1 -- 172.21.15.26:0/1169459512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c0094a0 con 0x7f5f9815c6e0 2023-06-09T04:38:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f977fe700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f980aed50 0x7f5f980c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f97fff700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 0x7f5f981f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9ce9e700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f9815c6e0 0x7f5f9806d460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000eb70 tx=0x7f5f9000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90009a80 con 0x7f5f9815c6e0 2023-06-09T04:38:52.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000f040 con 0x7f5f9815c6e0 2023-06-09T04:38:52.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f980c8a50 con 0x7f5f9815c6e0 2023-06-09T04:38:52.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000cc80 con 0x7f5f9815c6e0 2023-06-09T04:38:52.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.354+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f980c8110 con 0x7f5f9815c6e0 2023-06-09T04:38:52.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.355+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f980c9210 con 0x7f5f9815c6e0 2023-06-09T04:38:52.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.356+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f90014480 con 0x7f5f9815c6e0 2023-06-09T04:38:52.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.356+0000 7f5f94ff9700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f8406ace0 0x7f5f8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.356+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f90089af0 con 0x7f5f9815c6e0 2023-06-09T04:38:52.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.356+0000 7f5f97fff700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f8406ace0 0x7f5f8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.357+0000 7f5f97fff700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f8406ace0 0x7f5f8406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f88007d20 tx=0x7f5f88007c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.361+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f90058630 con 0x7f5f9815c6e0 2023-06-09T04:38:52.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.563+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f98067180 con 0x7f5f9815c6e0 2023-06-09T04:38:52.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.564+0000 7f5f94ff9700 1 -- 172.21.15.26:0/1169459512 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f5f900581c0 con 0x7f5f9815c6e0 2023-06-09T04:38:52.566 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:52.567 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:52.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f8406ace0 msgr2=0x7f5f8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f8406ace0 0x7f5f8406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f88007d20 tx=0x7f5f88007c70 comp rx=0 tx=0).stop 2023-06-09T04:38:52.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f9815c6e0 msgr2=0x7f5f9806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f9815c6e0 0x7f5f9806d460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000eb70 tx=0x7f5f9000ee80 comp rx=0 tx=0).stop 2023-06-09T04:38:52.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 shutdown_connections 2023-06-09T04:38:52.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f9815c6e0 0x7f5f9806d460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f9806e990 0x7f5f981f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f8406ace0 0x7f5f8406d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 --2- 172.21.15.26:0/1169459512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f980aed50 0x7f5f980c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 >> 172.21.15.26:0/1169459512 conn(0x7f5f98098a30 msgr2=0x7f5f980ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 shutdown_connections 2023-06-09T04:38:52.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.567+0000 7f5f9e901700 1 -- 172.21.15.26:0/1169459512 wait complete. 2023-06-09T04:38:52.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:52.582 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 Processor -- start 2023-06-09T04:38:52.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 -- start start 2023-06-09T04:38:52.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f73401569b0 0x7f73400cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f73400b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734015d950 con 0x7f73400cf370 2023-06-09T04:38:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400d0970 con 0x7f73401569b0 2023-06-09T04:38:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.709+0000 7f7345335700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400cd360 con 0x7f734015d3e0 2023-06-09T04:38:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f73400cf370 0x7f73400d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47862/0 (socket says 172.21.15.26:47862) 2023-06-09T04:38:52.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733e7fc700 1 -- 172.21.15.26:0/3188949250 learned_addr learned my addr 172.21.15.26:0/3188949250 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733f7fe700 1 --2- 172.21.15.26:0/3188949250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f73400b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733effd700 1 --2- 172.21.15.26:0/3188949250 >> v2:172.21.15.104:3300/0 conn(0x7f73401569b0 0x7f73400cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733dffb700 1 -- 172.21.15.26:0/3188949250 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846877287 0 0) 0x7f734015d950 con 0x7f73400cf370 2023-06-09T04:38:52.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733dffb700 1 -- 172.21.15.26:0/3188949250 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73280035b0 con 0x7f73400cf370 2023-06-09T04:38:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733f7fe700 1 -- 172.21.15.26:0/3188949250 >> v2:172.21.15.104:3300/0 conn(0x7f73401569b0 msgr2=0x7f73400cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733f7fe700 1 --2- 172.21.15.26:0/3188949250 >> v2:172.21.15.104:3300/0 conn(0x7f73401569b0 0x7f73400cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733f7fe700 1 -- 172.21.15.26:0/3188949250 >> v1:172.21.15.26:6789/0 conn(0x7f73400cf370 legacy=0x7f73400d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733f7fe700 1 -- 172.21.15.26:0/3188949250 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400cd640 con 0x7f734015d3e0 2023-06-09T04:38:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733effd700 1 --2- 172.21.15.26:0/3188949250 >> v2:172.21.15.104:3300/0 conn(0x7f73401569b0 0x7f73400cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.710+0000 7f733f7fe700 1 --2- 172.21.15.26:0/3188949250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f73400b7a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7338009d90 tx=0x7f733800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d409a8fa3c5d44a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f733dffb700 1 -- 172.21.15.26:0/3188949250 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800e070 con 0x7f734015d3e0 2023-06-09T04:38:52.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f733dffb700 1 -- 172.21.15.26:0/3188949250 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800bb20 con 0x7f734015d3e0 2023-06-09T04:38:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f733dffb700 1 -- 172.21.15.26:0/3188949250 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338012430 con 0x7f734015d3e0 2023-06-09T04:38:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 -- 172.21.15.26:0/3188949250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 msgr2=0x7f73400b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 --2- 172.21.15.26:0/3188949250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f73400b7a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7338009d90 tx=0x7f733800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:52.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 -- 172.21.15.26:0/3188949250 shutdown_connections 2023-06-09T04:38:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 --2- 172.21.15.26:0/3188949250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f73400b7a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 --2- 172.21.15.26:0/3188949250 >> v2:172.21.15.104:3300/0 conn(0x7f73401569b0 0x7f73400cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 -- 172.21.15.26:0/3188949250 >> 172.21.15.26:0/3188949250 conn(0x7f734006b1f0 msgr2=0x7f734006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 -- 172.21.15.26:0/3188949250 shutdown_connections 2023-06-09T04:38:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.711+0000 7f7345335700 1 -- 172.21.15.26:0/3188949250 wait complete. 2023-06-09T04:38:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 Processor -- start 2023-06-09T04:38:52.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 -- start start 2023-06-09T04:38:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 0x7f73400b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73401569b0 0x7f73400c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f7340149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400c7a20 con 0x7f73400cf370 2023-06-09T04:38:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400b8780 con 0x7f73401569b0 2023-06-09T04:38:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f7345335700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400c6da0 con 0x7f734015d3e0 2023-06-09T04:38:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f733effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 0x7f73400b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f733effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 0x7f73400b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39008/0 (socket says 172.21.15.26:39008) 2023-06-09T04:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.713+0000 7f733effd700 1 -- 172.21.15.26:0/998616376 learned_addr learned my addr 172.21.15.26:0/998616376 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733e7fc700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73401569b0 0x7f73400c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733f7fe700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f7340149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733effd700 1 -- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 msgr2=0x7f7340149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733effd700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f7340149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733effd700 1 -- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73401569b0 msgr2=0x7f73400c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733effd700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73401569b0 0x7f73400c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733effd700 1 -- 172.21.15.26:0/998616376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330009430 con 0x7f73400cf370 2023-06-09T04:38:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733e7fc700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73401569b0 0x7f73400c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f733effd700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 0x7f73400b6aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f733000ebe0 tx=0x7f7330009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330005a20 con 0x7f73400cf370 2023-06-09T04:38:52.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330005b80 con 0x7f73400cf370 2023-06-09T04:38:52.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7338009a70 con 0x7f73400cf370 2023-06-09T04:38:52.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000c8b0 con 0x7f73400cf370 2023-06-09T04:38:52.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.714+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73400c7360 con 0x7f73400cf370 2023-06-09T04:38:52.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.715+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73400c7d00 con 0x7f73400cf370 2023-06-09T04:38:52.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.715+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f733000ca10 con 0x7f73400cf370 2023-06-09T04:38:52.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.716+0000 7f73277fe700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f732c06ace0 0x7f732c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.716+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7330089770 con 0x7f73400cf370 2023-06-09T04:38:52.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.716+0000 7f733e7fc700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f732c06ace0 0x7f732c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.717+0000 7f733e7fc700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f732c06ace0 0x7f732c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f73400b8cd0 tx=0x7f7334009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.720+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7330054820 con 0x7f73400cf370 2023-06-09T04:38:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.918+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7340074080 con 0x7f73400cf370 2023-06-09T04:38:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.918+0000 7f73277fe700 1 -- 172.21.15.26:0/998616376 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7330057e40 con 0x7f73400cf370 2023-06-09T04:38:52.920 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:52.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f732c06ace0 msgr2=0x7f732c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f732c06ace0 0x7f732c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f73400b8cd0 tx=0x7f7334009040 comp rx=0 tx=0).stop 2023-06-09T04:38:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 msgr2=0x7f73400b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 0x7f73400b6aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f733000ebe0 tx=0x7f7330009e00 comp rx=0 tx=0).stop 2023-06-09T04:38:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 shutdown_connections 2023-06-09T04:38:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f734015d3e0 0x7f7340149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f732c06ace0 0x7f732c06d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73400cf370 0x7f73400b6aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 --2- 172.21.15.26:0/998616376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73401569b0 0x7f73400c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 >> 172.21.15.26:0/998616376 conn(0x7f734006b1f0 msgr2=0x7f73400d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 shutdown_connections 2023-06-09T04:38:52.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:52.920+0000 7f7345335700 1 -- 172.21.15.26:0/998616376 wait complete. 2023-06-09T04:38:52.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:53.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.060+0000 7f1219451700 1 Processor -- start 2023-06-09T04:38:53.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.060+0000 7f1219451700 1 -- start start 2023-06-09T04:38:53.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1219451700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f12140d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1219451700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12140d1300 0x7f12140b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1219451700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121415d950 con 0x7f12141569b0 2023-06-09T04:38:53.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1219451700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140d0970 con 0x7f12140d1300 2023-06-09T04:38:53.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1219451700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140cd360 con 0x7f121415d3e0 2023-06-09T04:38:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1212ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f12141569b0 0x7f12140cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47874/0 (socket says 172.21.15.26:47874) 2023-06-09T04:38:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1212ffd700 1 -- 172.21.15.26:0/53346337 learned_addr learned my addr 172.21.15.26:0/53346337 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f12137fe700 1 --2- 172.21.15.26:0/53346337 >> v2:172.21.15.104:3300/0 conn(0x7f12140d1300 0x7f12140b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f12127fc700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f12140d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756293159 0 0) 0x7f121415d950 con 0x7f12141569b0 2023-06-09T04:38:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc0035b0 con 0x7f12141569b0 2023-06-09T04:38:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425619857 0 0) 0x7f11fc0035b0 con 0x7f12141569b0 2023-06-09T04:38:53.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 msgr2=0x7f12140d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f12140d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 >> v2:172.21.15.104:3300/0 conn(0x7f12140d1300 msgr2=0x7f12140b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 --2- 172.21.15.26:0/53346337 >> v2:172.21.15.104:3300/0 conn(0x7f12140d1300 0x7f12140b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140cd640 con 0x7f12141569b0 2023-06-09T04:38:53.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f12080017f0 con 0x7f12141569b0 2023-06-09T04:38:53.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 >> v1:172.21.15.26:6789/0 conn(0x7f12141569b0 legacy=0x7f12140cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f11fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140d0970 con 0x7f11fc004850 2023-06-09T04:38:53.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140cd360 con 0x7f11fc003a00 2023-06-09T04:38:53.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.061+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00ba90 con 0x7f121415d3e0 2023-06-09T04:38:53.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f1212ffd700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12137fe700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f11fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 -- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 msgr2=0x7f11fc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f11fc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 -- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11fc003a00 msgr2=0x7f11fc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 -- 172.21.15.26:0/53346337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0035b0 con 0x7f11fc004850 2023-06-09T04:38:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12137fe700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f121415d3e0 0x7f11fc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f12127fc700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1204009b60 tx=0x7f11fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372813e973c6f9df server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400e6c0 con 0x7f11fc004850 2023-06-09T04:38:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120400e820 con 0x7f11fc004850 2023-06-09T04:38:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.062+0000 7f1211ffb700 1 -- 172.21.15.26:0/53346337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400eb90 con 0x7f11fc004850 2023-06-09T04:38:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f1219451700 1 -- 172.21.15.26:0/53346337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc004850 msgr2=0x7f11fc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f1219451700 1 --2- 172.21.15.26:0/53346337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1204009b60 tx=0x7f11fc005880 comp rx=0 tx=0).stop 2023-06-09T04:38:53.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f12137fe700 1 -- 172.21.15.26:0/53346337 reap_dead start 2023-06-09T04:38:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f1219451700 1 -- 172.21.15.26:0/53346337 shutdown_connections 2023-06-09T04:38:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f1219451700 1 -- 172.21.15.26:0/53346337 >> 172.21.15.26:0/53346337 conn(0x7f121406b1f0 msgr2=0x7f121406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f1219451700 1 -- 172.21.15.26:0/53346337 shutdown_connections 2023-06-09T04:38:53.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.063+0000 7f1219451700 1 -- 172.21.15.26:0/53346337 wait complete. 2023-06-09T04:38:53.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.064+0000 7f1219451700 1 Processor -- start 2023-06-09T04:38:53.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.064+0000 7f1219451700 1 -- start start 2023-06-09T04:38:53.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1219451700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11fc004850 0x7f12140c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1219451700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 0x7f12141471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1219451700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1214147720 0x7f12140b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1219451700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140ccb00 con 0x7f12140c7ce0 2023-06-09T04:38:53.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1219451700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140cbe80 con 0x7f1214147720 2023-06-09T04:38:53.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1219451700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140cc160 con 0x7f11fc004850 2023-06-09T04:38:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 0x7f12141471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 0x7f12141471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39030/0 (socket says 172.21.15.26:39030) 2023-06-09T04:38:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 -- 172.21.15.26:0/3437598629 learned_addr learned my addr 172.21.15.26:0/3437598629 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:53.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f1212ffd700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11fc004850 0x7f12140c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12137fe700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1214147720 0x7f12140b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 -- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11fc004850 msgr2=0x7f12140c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11fc004850 0x7f12140c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 -- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1214147720 msgr2=0x7f12140b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1214147720 0x7f12140b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.065+0000 7f12127fc700 1 -- 172.21.15.26:0/3437598629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140cc440 con 0x7f12140c7ce0 2023-06-09T04:38:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.066+0000 7f12127fc700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 0x7f12141471e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f11fc005810 tx=0x7f12040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.066+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204021070 con 0x7f12140c7ce0 2023-06-09T04:38:53.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.066+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204004470 con 0x7f12140c7ce0 2023-06-09T04:38:53.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.066+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140cc720 con 0x7f12140c7ce0 2023-06-09T04:38:53.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.066+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400e6c0 con 0x7f12140c7ce0 2023-06-09T04:38:53.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.066+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12140b3bb0 con 0x7f12140c7ce0 2023-06-09T04:38:53.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.067+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1214074080 con 0x7f12140c7ce0 2023-06-09T04:38:53.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.067+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1204025070 con 0x7f12140c7ce0 2023-06-09T04:38:53.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.068+0000 7f11fb7fe700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f120006ace0 0x7f120006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.068+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f120408a430 con 0x7f12140c7ce0 2023-06-09T04:38:53.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.068+0000 7f1212ffd700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f120006ace0 0x7f120006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.068+0000 7f1212ffd700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f120006ace0 0x7f120006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1208000ef0 tx=0x7f1208009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.072+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1204055690 con 0x7f12140c7ce0 2023-06-09T04:38:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.271+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12140d1940 con 0x7f12140c7ce0 2023-06-09T04:38:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.272+0000 7f11fb7fe700 1 -- 172.21.15.26:0/3437598629 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1204058cb0 con 0x7f12140c7ce0 2023-06-09T04:38:53.273 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.273+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f120006ace0 msgr2=0x7f120006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.273+0000 7f1219451700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f120006ace0 0x7f120006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1208000ef0 tx=0x7f1208009040 comp rx=0 tx=0).stop 2023-06-09T04:38:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.273+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 msgr2=0x7f12141471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.273+0000 7f1219451700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 0x7f12141471e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f11fc005810 tx=0x7f12040047c0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 shutdown_connections 2023-06-09T04:38:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1214147720 0x7f12140b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11fc004850 0x7f12140c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f120006ace0 0x7f120006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 --2- 172.21.15.26:0/3437598629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12140c7ce0 0x7f12141471e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 >> 172.21.15.26:0/3437598629 conn(0x7f121406b1f0 msgr2=0x7f1214154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 shutdown_connections 2023-06-09T04:38:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.274+0000 7f1219451700 1 -- 172.21.15.26:0/3437598629 wait complete. 2023-06-09T04:38:53.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.413+0000 7f6764851700 1 Processor -- start 2023-06-09T04:38:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.413+0000 7f6764851700 1 -- start start 2023-06-09T04:38:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.414+0000 7f6764851700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f676006ea70 0x7f6760163f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.414+0000 7f6764851700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6760159880 con 0x7f67600aed90 2023-06-09T04:38:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.414+0000 7f6764851700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676006cff0 con 0x7f67600ca540 2023-06-09T04:38:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.414+0000 7f6764851700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67600cda30 con 0x7f676006ea70 2023-06-09T04:38:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.414+0000 7f675e59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f67600aed90 0x7f67600c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47894/0 (socket says 172.21.15.26:47894) 2023-06-09T04:38:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.414+0000 7f675e59c700 1 -- 172.21.15.26:0/684881848 learned_addr learned my addr 172.21.15.26:0/684881848 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675ed9d700 1 --2- 172.21.15.26:0/684881848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f676006ea70 0x7f6760163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675d59a700 1 -- 172.21.15.26:0/684881848 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259993084 0 0) 0x7f6760159880 con 0x7f67600aed90 2023-06-09T04:38:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675d59a700 1 -- 172.21.15.26:0/684881848 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f674c0035b0 con 0x7f67600aed90 2023-06-09T04:38:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675d59a700 1 -- 172.21.15.26:0/684881848 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3957938691 0 0) 0x7f674c0035b0 con 0x7f67600aed90 2023-06-09T04:38:53.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675ed9d700 1 -- 172.21.15.26:0/684881848 >> v1:172.21.15.104:6789/0 conn(0x7f67600ca540 legacy=0x7f67600ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675ed9d700 1 -- 172.21.15.26:0/684881848 >> v1:172.21.15.26:6789/0 conn(0x7f67600aed90 legacy=0x7f67600c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675ed9d700 1 -- 172.21.15.26:0/684881848 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600cf250 con 0x7f676006ea70 2023-06-09T04:38:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675ed9d700 1 --2- 172.21.15.26:0/684881848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f676006ea70 0x7f6760163f90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6758009dc0 tx=0x7f675800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=510293e8bc70560c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675d59a700 1 -- 172.21.15.26:0/684881848 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800e070 con 0x7f676006ea70 2023-06-09T04:38:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675d59a700 1 -- 172.21.15.26:0/684881848 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758003a20 con 0x7f676006ea70 2023-06-09T04:38:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.415+0000 7f675d59a700 1 -- 172.21.15.26:0/684881848 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500017f0 con 0x7f676006ea70 2023-06-09T04:38:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 -- 172.21.15.26:0/684881848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f676006ea70 msgr2=0x7f6760163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 --2- 172.21.15.26:0/684881848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f676006ea70 0x7f6760163f90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6758009dc0 tx=0x7f675800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 -- 172.21.15.26:0/684881848 shutdown_connections 2023-06-09T04:38:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 --2- 172.21.15.26:0/684881848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f676006ea70 0x7f6760163f90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 -- 172.21.15.26:0/684881848 >> 172.21.15.26:0/684881848 conn(0x7f6760098a30 msgr2=0x7f67600cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:53.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 -- 172.21.15.26:0/684881848 shutdown_connections 2023-06-09T04:38:53.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.416+0000 7f6764851700 1 -- 172.21.15.26:0/684881848 wait complete. 2023-06-09T04:38:53.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.417+0000 7f6764851700 1 Processor -- start 2023-06-09T04:38:53.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 -- start start 2023-06-09T04:38:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f676006ea70 0x7f6760154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67600aed90 0x7f67600afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 0x7f67600b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600c6ac0 con 0x7f67600ca540 2023-06-09T04:38:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600b0340 con 0x7f676006ea70 2023-06-09T04:38:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f6764851700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67600b0620 con 0x7f67600aed90 2023-06-09T04:38:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f675ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 0x7f67600b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f675ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 0x7f67600b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39046/0 (socket says 172.21.15.26:39046) 2023-06-09T04:38:53.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.418+0000 7f675ed9d700 1 -- 172.21.15.26:0/1338144040 learned_addr learned my addr 172.21.15.26:0/1338144040 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:53.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675e59c700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f676006ea70 0x7f6760154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675dd9b700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67600aed90 0x7f67600afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675ed9d700 1 -- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67600aed90 msgr2=0x7f67600afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675ed9d700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67600aed90 0x7f67600afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675ed9d700 1 -- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f676006ea70 msgr2=0x7f6760154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675ed9d700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f676006ea70 0x7f6760154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675ed9d700 1 -- 172.21.15.26:0/1338144040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6758009a70 con 0x7f67600ca540 2023-06-09T04:38:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675dd9b700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67600aed90 0x7f67600afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f675ed9d700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 0x7f67600b34c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f675800b370 tx=0x7f6758004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580045c0 con 0x7f67600ca540 2023-06-09T04:38:53.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758004720 con 0x7f67600ca540 2023-06-09T04:38:53.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67600b0900 con 0x7f67600ca540 2023-06-09T04:38:53.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758012450 con 0x7f67600ca540 2023-06-09T04:38:53.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.419+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67600aff80 con 0x7f67600ca540 2023-06-09T04:38:53.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.420+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67600c6c70 con 0x7f67600ca540 2023-06-09T04:38:53.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.421+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67580125b0 con 0x7f67600ca540 2023-06-09T04:38:53.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.421+0000 7f6756ffd700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f674006ace0 0x7f674006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.421+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f675808adb0 con 0x7f67600ca540 2023-06-09T04:38:53.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.421+0000 7f675e59c700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f674006ace0 0x7f674006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.422+0000 7f675e59c700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f674006ace0 0x7f674006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6750001420 tx=0x7f67500013b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.426+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67600c6c70 con 0x7f67600ca540 2023-06-09T04:38:53.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.626+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67600c68b0 con 0x7f67600ca540 2023-06-09T04:38:53.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.626+0000 7f6756ffd700 1 -- 172.21.15.26:0/1338144040 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6758059980 con 0x7f67600ca540 2023-06-09T04:38:53.628 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f674006ace0 msgr2=0x7f674006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f674006ace0 0x7f674006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6750001420 tx=0x7f67500013b0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 msgr2=0x7f67600b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 0x7f67600b34c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f675800b370 tx=0x7f6758004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 shutdown_connections 2023-06-09T04:38:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f674006ace0 0x7f674006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67600ca540 0x7f67600b34c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f676006ea70 0x7f6760154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 --2- 172.21.15.26:0/1338144040 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67600aed90 0x7f67600afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 >> 172.21.15.26:0/1338144040 conn(0x7f6760098a30 msgr2=0x7f67600cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:53.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.628+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 shutdown_connections 2023-06-09T04:38:53.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.629+0000 7f6764851700 1 -- 172.21.15.26:0/1338144040 wait complete. 2023-06-09T04:38:53.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.771+0000 7f036b19f700 1 Processor -- start 2023-06-09T04:38:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.771+0000 7f036b19f700 1 -- start start 2023-06-09T04:38:53.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.771+0000 7f036b19f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 0x7f036406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036b19f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640af230 con 0x7f03640c9c90 2023-06-09T04:38:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036b19f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640afa90 con 0x7f03640b03e0 2023-06-09T04:38:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036b19f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03640af0a0 con 0x7f036415c4a0 2023-06-09T04:38:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036999c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f03640c9c90 0x7f03640afcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47910/0 (socket says 172.21.15.26:47910) 2023-06-09T04:38:53.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036999c700 1 -- 172.21.15.26:0/537886596 learned_addr learned my addr 172.21.15.26:0/537886596 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245335396 0 0) 0x7f03640af230 con 0x7f03640c9c90 2023-06-09T04:38:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03500035b0 con 0x7f03640c9c90 2023-06-09T04:38:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036a19d700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 0x7f036406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457438822 0 0) 0x7f03500035b0 con 0x7f03640c9c90 2023-06-09T04:38:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 msgr2=0x7f036406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 0x7f036406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 >> v1:172.21.15.104:6789/0 conn(0x7f03640b03e0 legacy=0x7f03640ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640d0540 con 0x7f03640c9c90 2023-06-09T04:38:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f0360001670 con 0x7f03640c9c90 2023-06-09T04:38:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 >> v1:172.21.15.26:6789/0 conn(0x7f03640c9c90 legacy=0x7f03640afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350003a30 0x7f0350003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0350004850 0x7f0350004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 0x7f03500052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640af0a0 con 0x7f0350004850 2023-06-09T04:38:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035000bba0 con 0x7f0350003a30 2023-06-09T04:38:53.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035000bd30 con 0x7f036415c4a0 2023-06-09T04:38:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.772+0000 7f036999c700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0350004850 0x7f0350004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036a19d700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350003a30 0x7f0350003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036a99e700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 0x7f03500052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036999c700 1 -- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 msgr2=0x7f03500052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036999c700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f036415c4a0 0x7f03500052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036999c700 1 -- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350003a30 msgr2=0x7f0350003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:53.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036999c700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350003a30 0x7f0350003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036999c700 1 -- 172.21.15.26:0/537886596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500035b0 con 0x7f0350004850 2023-06-09T04:38:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036a19d700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350003a30 0x7f0350003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036999c700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0350004850 0x7f0350004cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f036000c190 tx=0x7f0350005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3913e44ead9529af server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360007b70 con 0x7f0350004850 2023-06-09T04:38:53.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036000ccf0 con 0x7f0350004850 2023-06-09T04:38:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.773+0000 7f036919b700 1 -- 172.21.15.26:0/537886596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360005ba0 con 0x7f0350004850 2023-06-09T04:38:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036b19f700 1 -- 172.21.15.26:0/537886596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0350004850 msgr2=0x7f0350004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036b19f700 1 --2- 172.21.15.26:0/537886596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0350004850 0x7f0350004cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f036000c190 tx=0x7f0350005880 comp rx=0 tx=0).stop 2023-06-09T04:38:53.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036a99e700 1 -- 172.21.15.26:0/537886596 reap_dead start 2023-06-09T04:38:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036b19f700 1 -- 172.21.15.26:0/537886596 shutdown_connections 2023-06-09T04:38:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036b19f700 1 -- 172.21.15.26:0/537886596 >> 172.21.15.26:0/537886596 conn(0x7f036406b7e0 msgr2=0x7f03640cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036b19f700 1 -- 172.21.15.26:0/537886596 shutdown_connections 2023-06-09T04:38:53.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.774+0000 7f036b19f700 1 -- 172.21.15.26:0/537886596 wait complete. 2023-06-09T04:38:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.775+0000 7f036b19f700 1 Processor -- start 2023-06-09T04:38:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.775+0000 7f036b19f700 1 -- start start 2023-06-09T04:38:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036b19f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350004850 0x7f0364157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036b19f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f03640c77b0 0x7f03640c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036b19f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 0x7f03641597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036b19f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640c7390 con 0x7f03640c8380 2023-06-09T04:38:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036b19f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640c8820 con 0x7f0350004850 2023-06-09T04:38:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036b19f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03640c6710 con 0x7f03640c77b0 2023-06-09T04:38:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 0x7f03641597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 0x7f03641597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39066/0 (socket says 172.21.15.26:39066) 2023-06-09T04:38:53.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 -- 172.21.15.26:0/1559977392 learned_addr learned my addr 172.21.15.26:0/1559977392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:53.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a19d700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350004850 0x7f0364157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036999c700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f03640c77b0 0x7f03640c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 -- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f03640c77b0 msgr2=0x7f03640c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f03640c77b0 0x7f03640c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 -- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350004850 msgr2=0x7f0364157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350004850 0x7f0364157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 -- 172.21.15.26:0/1559977392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640c69f0 con 0x7f03640c8380 2023-06-09T04:38:53.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.776+0000 7f036a99e700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 0x7f03641597d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0364070570 tx=0x7f035c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.777+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c003a00 con 0x7f03640c8380 2023-06-09T04:38:53.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.777+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c003b60 con 0x7f03640c8380 2023-06-09T04:38:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.777+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03640c6cd0 con 0x7f03640c8380 2023-06-09T04:38:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.777+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00d930 con 0x7f03640c8380 2023-06-09T04:38:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.777+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0364157650 con 0x7f03640c8380 2023-06-09T04:38:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.778+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03640c74d0 con 0x7f03640c8380 2023-06-09T04:38:53.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.778+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f035c00da90 con 0x7f03640c8380 2023-06-09T04:38:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.778+0000 7f035affd700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f034806ace0 0x7f034806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.778+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f035c089430 con 0x7f03640c8380 2023-06-09T04:38:53.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.779+0000 7f036a19d700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f034806ace0 0x7f034806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:53.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.779+0000 7f036a19d700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f034806ace0 0x7f034806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03640ae1e0 tx=0x7f03540091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:53.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.783+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03640c74d0 con 0x7f03640c8380 2023-06-09T04:38:53.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.981+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03640c74d0 con 0x7f03640c8380 2023-06-09T04:38:53.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.981+0000 7f035affd700 1 -- 172.21.15.26:0/1559977392 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03640c74d0 con 0x7f03640c8380 2023-06-09T04:38:53.983 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f034806ace0 msgr2=0x7f034806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f034806ace0 0x7f034806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03640ae1e0 tx=0x7f03540091c0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 msgr2=0x7f03641597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 0x7f03641597d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0364070570 tx=0x7f035c00d430 comp rx=0 tx=0).stop 2023-06-09T04:38:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 shutdown_connections 2023-06-09T04:38:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f034806ace0 0x7f034806d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640c8380 0x7f03641597d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0350004850 0x7f0364157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 --2- 172.21.15.26:0/1559977392 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f03640c77b0 0x7f03640c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 >> 172.21.15.26:0/1559977392 conn(0x7f036406b7e0 msgr2=0x7f036406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 shutdown_connections 2023-06-09T04:38:53.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:53.983+0000 7f036b19f700 1 -- 172.21.15.26:0/1559977392 wait complete. 2023-06-09T04:38:53.997 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.123+0000 7f15b2af6700 1 Processor -- start 2023-06-09T04:38:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.123+0000 7f15b2af6700 1 -- start start 2023-06-09T04:38:54.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b2af6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b2af6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15ac0d0c50 0x7f15ac0d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b2af6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0cf400 con 0x7f15ac0d1840 2023-06-09T04:38:54.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b2af6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0ceec0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b2af6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15d830 con 0x7f15ac159d00 2023-06-09T04:38:54.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15abfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f15ac0d1840 0x7f15ac0cf890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47930/0 (socket says 172.21.15.26:47930) 2023-06-09T04:38:54.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15abfff700 1 -- 172.21.15.26:0/751162893 learned_addr learned my addr 172.21.15.26:0/751162893 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:54.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b0892700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.124+0000 7f15b1093700 1 --2- 172.21.15.26:0/751162893 >> v2:172.21.15.104:3300/0 conn(0x7f15ac0d0c50 0x7f15ac0d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15ab7fe700 1 -- 172.21.15.26:0/751162893 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361832411 0 0) 0x7f15ac0cf400 con 0x7f15ac0d1840 2023-06-09T04:38:54.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15ab7fe700 1 -- 172.21.15.26:0/751162893 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f159c0035b0 con 0x7f15ac0d1840 2023-06-09T04:38:54.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15b1093700 1 -- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 msgr2=0x7f15ac15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:54.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15b1093700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac15d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15b1093700 1 -- 172.21.15.26:0/751162893 >> v1:172.21.15.26:6789/0 conn(0x7f15ac0d1840 legacy=0x7f15ac0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15b1093700 1 -- 172.21.15.26:0/751162893 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0cf0d0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15b0892700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:54.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15b1093700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d0c50 0x7f15ac0d1090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009d90 tx=0x7f15a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e98bd5ac10c6896a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15ab7fe700 1 -- 172.21.15.26:0/751162893 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400e070 con 0x7f15ac0d0c50 2023-06-09T04:38:54.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15ab7fe700 1 -- 172.21.15.26:0/751162893 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400bb20 con 0x7f15ac0d0c50 2023-06-09T04:38:54.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.125+0000 7f15ab7fe700 1 -- 172.21.15.26:0/751162893 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4012430 con 0x7f15ac0d0c50 2023-06-09T04:38:54.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 -- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d0c50 msgr2=0x7f15ac0d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d0c50 0x7f15ac0d1090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009d90 tx=0x7f15a400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:54.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 -- 172.21.15.26:0/751162893 shutdown_connections 2023-06-09T04:38:54.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d0c50 0x7f15ac0d1090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 --2- 172.21.15.26:0/751162893 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 -- 172.21.15.26:0/751162893 >> 172.21.15.26:0/751162893 conn(0x7f15ac0714e0 msgr2=0x7f15ac0718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:54.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 -- 172.21.15.26:0/751162893 shutdown_connections 2023-06-09T04:38:54.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.126+0000 7f15b2af6700 1 -- 172.21.15.26:0/751162893 wait complete. 2023-06-09T04:38:54.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.127+0000 7f15b2af6700 1 Processor -- start 2023-06-09T04:38:54.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.127+0000 7f15b2af6700 1 -- start start 2023-06-09T04:38:54.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b2af6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 0x7f15ac155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b2af6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d1840 0x7f15ac0b8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b2af6700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b2af6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b7dd0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b2af6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c6c80 con 0x7f15ac0d1840 2023-06-09T04:38:54.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b2af6700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b5a70 con 0x7f15ac159d00 2023-06-09T04:38:54.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b0892700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 0x7f15ac155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b0892700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 0x7f15ac155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39076/0 (socket says 172.21.15.26:39076) 2023-06-09T04:38:54.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b0892700 1 -- 172.21.15.26:0/446126326 learned_addr learned my addr 172.21.15.26:0/446126326 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:54.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15b1093700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.128+0000 7f15abfff700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d1840 0x7f15ac0b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b0892700 1 -- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 msgr2=0x7f15ac0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b0892700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b0892700 1 -- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d1840 msgr2=0x7f15ac0b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b0892700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d1840 0x7f15ac0b8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b0892700 1 -- 172.21.15.26:0/446126326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0009430 con 0x7f15ac0d0c50 2023-06-09T04:38:54.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b0892700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 0x7f15ac155750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15a000ec10 tx=0x7f15a000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0005a20 con 0x7f15ac0d0c50 2023-06-09T04:38:54.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0005b80 con 0x7f15ac0d0c50 2023-06-09T04:38:54.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000c850 con 0x7f15ac0d0c50 2023-06-09T04:38:54.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4009a70 con 0x7f15ac0d0c50 2023-06-09T04:38:54.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.129+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0cadc0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.130+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0cafe0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.131+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15a000c9b0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.131+0000 7f15a97fa700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f159006ace0 0x7f159006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.131+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15a0089690 con 0x7f15ac0d0c50 2023-06-09T04:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.131+0000 7f15abfff700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f159006ace0 0x7f159006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.132+0000 7f15abfff700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f159006ace0 0x7f159006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1598007fd0 tx=0x7f1598007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.136+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15a0058260 con 0x7f15ac0d0c50 2023-06-09T04:38:54.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.350+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15ac073ba0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.351+0000 7f15a97fa700 1 -- 172.21.15.26:0/446126326 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f15a0057df0 con 0x7f15ac0d0c50 2023-06-09T04:38:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.352+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f159006ace0 msgr2=0x7f159006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.352+0000 7f15b2af6700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f159006ace0 0x7f159006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1598007fd0 tx=0x7f1598007dc0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.352+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 msgr2=0x7f15ac155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.352+0000 7f15b2af6700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 0x7f15ac155750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15a000ec10 tx=0x7f15a000ef20 comp rx=0 tx=0).stop 2023-06-09T04:38:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 shutdown_connections 2023-06-09T04:38:54.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15ac159d00 0x7f15ac0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f159006ace0 0x7f159006d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15ac0d0c50 0x7f15ac155750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 --2- 172.21.15.26:0/446126326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15ac0d1840 0x7f15ac0b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 >> 172.21.15.26:0/446126326 conn(0x7f15ac0714e0 msgr2=0x7f15ac0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 shutdown_connections 2023-06-09T04:38:54.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.353+0000 7f15b2af6700 1 -- 172.21.15.26:0/446126326 wait complete. 2023-06-09T04:38:54.358 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:38:54.366 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:38:54.367 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:54.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.513+0000 7f8509bc3700 1 Processor -- start 2023-06-09T04:38:54.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.513+0000 7f8509bc3700 1 -- start start 2023-06-09T04:38:54.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8509bc3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f850415c6e0 0x7f85040ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8509bc3700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f850406e990 0x7f85040aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8509bc3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850406f190 con 0x7f8504098e30 2023-06-09T04:38:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8509bc3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850406e440 con 0x7f850415c6e0 2023-06-09T04:38:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8509bc3700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850406e690 con 0x7f850406e990 2023-06-09T04:38:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85037fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f850415c6e0 0x7f85040ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8502ffd700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f850406e990 0x7f85040aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8503fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8504098e30 0x7f85040cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:46858/0 (socket says 172.21.15.26:46858) 2023-06-09T04:38:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f8503fff700 1 -- 172.21.15.26:0/455695560 learned_addr learned my addr 172.21.15.26:0/455695560 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85027fc700 1 -- 172.21.15.26:0/455695560 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618069649 0 0) 0x7f850406f190 con 0x7f8504098e30 2023-06-09T04:38:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85027fc700 1 -- 172.21.15.26:0/455695560 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ec0035b0 con 0x7f8504098e30 2023-06-09T04:38:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85037fe700 1 -- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f850406e990 msgr2=0x7f85040aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85037fe700 1 --2- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f850406e990 0x7f85040aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85037fe700 1 -- 172.21.15.26:0/455695560 >> v1:172.21.15.104:6789/0 conn(0x7f8504098e30 legacy=0x7f85040cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.514+0000 7f85037fe700 1 -- 172.21.15.26:0/455695560 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504160300 con 0x7f850415c6e0 2023-06-09T04:38:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f85037fe700 1 --2- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040ae640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009820 tx=0x7f84f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aeceb9ce50f493 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f85027fc700 1 -- 172.21.15.26:0/455695560 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4005e30 con 0x7f850415c6e0 2023-06-09T04:38:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f85027fc700 1 -- 172.21.15.26:0/455695560 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4006030 con 0x7f850415c6e0 2023-06-09T04:38:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f85027fc700 1 -- 172.21.15.26:0/455695560 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40063c0 con 0x7f850415c6e0 2023-06-09T04:38:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 -- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 msgr2=0x7f85040ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 --2- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040ae640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009820 tx=0x7f84f4009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 -- 172.21.15.26:0/455695560 shutdown_connections 2023-06-09T04:38:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 --2- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040ae640 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 --2- 172.21.15.26:0/455695560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f850406e990 0x7f85040aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 -- 172.21.15.26:0/455695560 >> 172.21.15.26:0/455695560 conn(0x7f8504098a30 msgr2=0x7f85040cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:54.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 -- 172.21.15.26:0/455695560 shutdown_connections 2023-06-09T04:38:54.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.515+0000 7f8509bc3700 1 -- 172.21.15.26:0/455695560 wait complete. 2023-06-09T04:38:54.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.517+0000 7f8509bc3700 1 Processor -- start 2023-06-09T04:38:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.517+0000 7f8509bc3700 1 -- start start 2023-06-09T04:38:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.517+0000 7f8509bc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 0x7f8504153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.517+0000 7f8509bc3700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8504098e30 0x7f85040b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8509bc3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8509bc3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b2ec0 con 0x7f850406e990 2023-06-09T04:38:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8509bc3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b0e60 con 0x7f850415c6e0 2023-06-09T04:38:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8509bc3700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b1140 con 0x7f8504098e30 2023-06-09T04:38:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 0x7f8504153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 0x7f8504153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39090/0 (socket says 172.21.15.26:39090) 2023-06-09T04:38:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 -- 172.21.15.26:0/4134841160 learned_addr learned my addr 172.21.15.26:0/4134841160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8502ffd700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8504098e30 0x7f85040b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8503fff700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 -- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8504098e30 msgr2=0x7f85040b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8504098e30 0x7f85040b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 -- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 msgr2=0x7f85040b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 -- 172.21.15.26:0/4134841160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009430 con 0x7f850406e990 2023-06-09T04:38:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8503fff700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:54.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f85037fe700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 0x7f8504153cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f84f4000c00 tx=0x7f84f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40065b0 con 0x7f850406e990 2023-06-09T04:38:54.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4006710 con 0x7f850406e990 2023-06-09T04:38:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85040b1420 con 0x7f850406e990 2023-06-09T04:38:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40036a0 con 0x7f850406e990 2023-06-09T04:38:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.518+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8504154200 con 0x7f850406e990 2023-06-09T04:38:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.519+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85040d0780 con 0x7f850406e990 2023-06-09T04:38:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.520+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84f4022070 con 0x7f850406e990 2023-06-09T04:38:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.520+0000 7f84ebfff700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f84f006ace0 0x7f84f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.520+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84f408ab80 con 0x7f850406e990 2023-06-09T04:38:54.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.520+0000 7f8502ffd700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f84f006ace0 0x7f84f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.521+0000 7f8502ffd700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f84f006ace0 0x7f84f006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f850415fc90 tx=0x7f84f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.525+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84f4055cc0 con 0x7f850406e990 2023-06-09T04:38:54.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.723+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85040ca980 con 0x7f850406e990 2023-06-09T04:38:54.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.724+0000 7f84ebfff700 1 -- 172.21.15.26:0/4134841160 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f84f402a020 con 0x7f850406e990 2023-06-09T04:38:54.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:54.726 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:54.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f84f006ace0 msgr2=0x7f84f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f84f006ace0 0x7f84f006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f850415fc90 tx=0x7f84f8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:54.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 msgr2=0x7f8504153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 0x7f8504153cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f84f4000c00 tx=0x7f84f4004750 comp rx=0 tx=0).stop 2023-06-09T04:38:54.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 shutdown_connections 2023-06-09T04:38:54.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f850415c6e0 0x7f85040b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f84f006ace0 0x7f84f006d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f850406e990 0x7f8504153cc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 --2- 172.21.15.26:0/4134841160 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8504098e30 0x7f85040b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 >> 172.21.15.26:0/4134841160 conn(0x7f8504098a30 msgr2=0x7f85040adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:54.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 shutdown_connections 2023-06-09T04:38:54.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.726+0000 7f8509bc3700 1 -- 172.21.15.26:0/4134841160 wait complete. 2023-06-09T04:38:54.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:54.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.868+0000 7fcc7da1e700 1 Processor -- start 2023-06-09T04:38:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.868+0000 7fcc7da1e700 1 -- start start 2023-06-09T04:38:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc7da1e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc781569b0 0x7fcc780cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc7da1e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc780cf370 0x7fcc780d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc7da1e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcc7815d3e0 0x7fcc780d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc7da1e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc780d0970 con 0x7fcc780cf370 2023-06-09T04:38:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc7da1e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc780d1840 con 0x7fcc7815d3e0 2023-06-09T04:38:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc7da1e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7815d950 con 0x7fcc781569b0 2023-06-09T04:38:54.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc780cf370 0x7fcc780d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc780cf370 0x7fcc780d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39098/0 (socket says 172.21.15.26:39098) 2023-06-09T04:38:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 -- 172.21.15.26:0/2422837114 learned_addr learned my addr 172.21.15.26:0/2422837114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc777fe700 1 --2- 172.21.15.26:0/2422837114 >> v2:172.21.15.104:3300/0 conn(0x7fcc7815d3e0 0x7fcc780d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc76ffd700 1 --2- 172.21.15.26:0/2422837114 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc781569b0 0x7fcc780cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 -- 172.21.15.26:0/2422837114 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc781569b0 msgr2=0x7fcc780cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 --2- 172.21.15.26:0/2422837114 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc781569b0 0x7fcc780cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 -- 172.21.15.26:0/2422837114 >> v2:172.21.15.104:3300/0 conn(0x7fcc7815d3e0 msgr2=0x7fcc780d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 --2- 172.21.15.26:0/2422837114 >> v2:172.21.15.104:3300/0 conn(0x7fcc7815d3e0 0x7fcc780d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 -- 172.21.15.26:0/2422837114 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780cd360 con 0x7fcc780cf370 2023-06-09T04:38:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc777fe700 1 --2- 172.21.15.26:0/2422837114 >> v2:172.21.15.104:3300/0 conn(0x7fcc7815d3e0 0x7fcc780d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.869+0000 7fcc767fc700 1 --2- 172.21.15.26:0/2422837114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc780cf370 0x7fcc780d0dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc780b4da0 tx=0x7fcc68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04395fb694c422 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc75ffb700 1 -- 172.21.15.26:0/2422837114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800b870 con 0x7fcc780cf370 2023-06-09T04:38:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc75ffb700 1 -- 172.21.15.26:0/2422837114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800b9d0 con 0x7fcc780cf370 2023-06-09T04:38:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc75ffb700 1 -- 172.21.15.26:0/2422837114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800bd60 con 0x7fcc780cf370 2023-06-09T04:38:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 -- 172.21.15.26:0/2422837114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc780cf370 msgr2=0x7fcc780d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/2422837114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc780cf370 0x7fcc780d0dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc780b4da0 tx=0x7fcc68009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 -- 172.21.15.26:0/2422837114 shutdown_connections 2023-06-09T04:38:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/2422837114 >> v2:172.21.15.104:3300/0 conn(0x7fcc7815d3e0 0x7fcc780d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/2422837114 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc781569b0 0x7fcc780cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/2422837114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc780cf370 0x7fcc780d0dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 -- 172.21.15.26:0/2422837114 >> 172.21.15.26:0/2422837114 conn(0x7fcc7806b1f0 msgr2=0x7fcc7806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 -- 172.21.15.26:0/2422837114 shutdown_connections 2023-06-09T04:38:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.870+0000 7fcc7da1e700 1 -- 172.21.15.26:0/2422837114 wait complete. 2023-06-09T04:38:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.871+0000 7fcc7da1e700 1 Processor -- start 2023-06-09T04:38:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 -- start start 2023-06-09T04:38:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc780cf370 0x7fcc78152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 0x7fcc780c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc7815d3e0 0x7fcc780b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780ca020 con 0x7fcc781569b0 2023-06-09T04:38:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780cc590 con 0x7fcc780cf370 2023-06-09T04:38:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc7da1e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780cc870 con 0x7fcc7815d3e0 2023-06-09T04:38:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc767fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 0x7fcc780c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc767fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 0x7fcc780c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39104/0 (socket says 172.21.15.26:39104) 2023-06-09T04:38:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.872+0000 7fcc767fc700 1 -- 172.21.15.26:0/3899775800 learned_addr learned my addr 172.21.15.26:0/3899775800 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc76ffd700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc780cf370 0x7fcc78152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc777fe700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc7815d3e0 0x7fcc780b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc767fc700 1 -- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc7815d3e0 msgr2=0x7fcc780b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc767fc700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc7815d3e0 0x7fcc780b7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc767fc700 1 -- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc780cf370 msgr2=0x7fcc78152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc767fc700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc780cf370 0x7fcc78152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc767fc700 1 -- 172.21.15.26:0/3899775800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68009550 con 0x7fcc781569b0 2023-06-09T04:38:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc767fc700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 0x7fcc780c8170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc68014040 tx=0x7fcc68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68004500 con 0x7fcc781569b0 2023-06-09T04:38:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680036a0 con 0x7fcc781569b0 2023-06-09T04:38:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc780ccb50 con 0x7fcc781569b0 2023-06-09T04:38:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68003a10 con 0x7fcc781569b0 2023-06-09T04:38:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.873+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc781530b0 con 0x7fcc781569b0 2023-06-09T04:38:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.874+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc780cde90 con 0x7fcc781569b0 2023-06-09T04:38:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.875+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc68003b70 con 0x7fcc781569b0 2023-06-09T04:38:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.875+0000 7fcc5ffff700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcc6406ace0 0x7fcc6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.875+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc6808a9d0 con 0x7fcc781569b0 2023-06-09T04:38:54.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.875+0000 7fcc76ffd700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcc6406ace0 0x7fcc6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:54.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.876+0000 7fcc76ffd700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcc6406ace0 0x7fcc6406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00a970 tx=0x7fcc6c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:54.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:54.879+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc68055b10 con 0x7fcc781569b0 2023-06-09T04:38:55.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.075+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc780cea70 con 0x7fcc781569b0 2023-06-09T04:38:55.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.075+0000 7fcc5ffff700 1 -- 172.21.15.26:0/3899775800 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc68059130 con 0x7fcc781569b0 2023-06-09T04:38:55.077 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:55.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcc6406ace0 msgr2=0x7fcc6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcc6406ace0 0x7fcc6406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00a970 tx=0x7fcc6c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:55.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 msgr2=0x7fcc780c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 0x7fcc780c8170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc68014040 tx=0x7fcc68004750 comp rx=0 tx=0).stop 2023-06-09T04:38:55.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 shutdown_connections 2023-06-09T04:38:55.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcc7815d3e0 0x7fcc780b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc780cf370 0x7fcc78152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcc6406ace0 0x7fcc6406d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 --2- 172.21.15.26:0/3899775800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc781569b0 0x7fcc780c8170 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 >> 172.21.15.26:0/3899775800 conn(0x7fcc7806b1f0 msgr2=0x7fcc780b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 shutdown_connections 2023-06-09T04:38:55.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.077+0000 7fcc7da1e700 1 -- 172.21.15.26:0/3899775800 wait complete. 2023-06-09T04:38:55.091 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:55.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.218+0000 7fef85053700 1 Processor -- start 2023-06-09T04:38:55.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.218+0000 7fef85053700 1 -- start start 2023-06-09T04:38:55.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef85053700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef800aed50 0x7fef80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef85053700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fef8006e990 0x7fef8006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef85053700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8006f190 con 0x7fef8015c6e0 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef85053700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8006e440 con 0x7fef800aed50 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef85053700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8006e690 con 0x7fef8006e990 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef800aed50 0x7fef80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef800aed50 0x7fef80069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39112/0 (socket says 172.21.15.26:39112) 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 -- 172.21.15.26:0/2203771087 learned_addr learned my addr 172.21.15.26:0/2203771087 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:55.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7f59e700 1 --2- 172.21.15.26:0/2203771087 >> v2:172.21.15.104:3300/0 conn(0x7fef8006e990 0x7fef8006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 -- 172.21.15.26:0/2203771087 >> v2:172.21.15.104:3300/0 conn(0x7fef8006e990 msgr2=0x7fef8006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 --2- 172.21.15.26:0/2203771087 >> v2:172.21.15.104:3300/0 conn(0x7fef8006e990 0x7fef8006a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 -- 172.21.15.26:0/2203771087 >> v1:172.21.15.104:6789/0 conn(0x7fef8015c6e0 legacy=0x7fef800ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.219+0000 7fef7e59c700 1 -- 172.21.15.26:0/2203771087 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80160300 con 0x7fef800aed50 2023-06-09T04:38:55.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef7e59c700 1 --2- 172.21.15.26:0/2203771087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef800aed50 0x7fef80069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef80066500 tx=0x7fef70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cfb592c1f5c314 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef7dd9b700 1 -- 172.21.15.26:0/2203771087 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011830 con 0x7fef800aed50 2023-06-09T04:38:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef7dd9b700 1 -- 172.21.15.26:0/2203771087 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70011990 con 0x7fef800aed50 2023-06-09T04:38:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef7dd9b700 1 -- 172.21.15.26:0/2203771087 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011d20 con 0x7fef800aed50 2023-06-09T04:38:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 -- 172.21.15.26:0/2203771087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef800aed50 msgr2=0x7fef80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 --2- 172.21.15.26:0/2203771087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef800aed50 0x7fef80069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef80066500 tx=0x7fef70009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 -- 172.21.15.26:0/2203771087 shutdown_connections 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 --2- 172.21.15.26:0/2203771087 >> v2:172.21.15.104:3300/0 conn(0x7fef8006e990 0x7fef8006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 --2- 172.21.15.26:0/2203771087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef800aed50 0x7fef80069db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 -- 172.21.15.26:0/2203771087 >> 172.21.15.26:0/2203771087 conn(0x7fef80098a30 msgr2=0x7fef800cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 -- 172.21.15.26:0/2203771087 shutdown_connections 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.220+0000 7fef85053700 1 -- 172.21.15.26:0/2203771087 wait complete. 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.222+0000 7fef85053700 1 Processor -- start 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.222+0000 7fef85053700 1 -- start start 2023-06-09T04:38:55.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 0x7fef800b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fef800aed50 0x7fef80149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef8015c6e0 0x7fef800c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b4610 con 0x7fef8006e990 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b4f70 con 0x7fef8015c6e0 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b3990 con 0x7fef800aed50 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 0x7fef800b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 0x7fef800b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39114/0 (socket says 172.21.15.26:39114) 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 -- 172.21.15.26:0/4230365917 learned_addr learned my addr 172.21.15.26:0/4230365917 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7f59e700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef8015c6e0 0x7fef800c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7e59c700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fef800aed50 0x7fef80149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 -- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fef800aed50 msgr2=0x7fef80149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fef800aed50 0x7fef80149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 -- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef8015c6e0 msgr2=0x7fef800c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef8015c6e0 0x7fef800c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 -- 172.21.15.26:0/4230365917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009550 con 0x7fef8006e990 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7f59e700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef8015c6e0 0x7fef800c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef7ed9d700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 0x7fef800b4a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c4d0 tx=0x7fef7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740052d0 con 0x7fef8006e990 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74005430 con 0x7fef8006e990 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef800b3c70 con 0x7fef8006e990 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740038f0 con 0x7fef8006e990 2023-06-09T04:38:55.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.223+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef800b4230 con 0x7fef8006e990 2023-06-09T04:38:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.224+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80067180 con 0x7fef8006e990 2023-06-09T04:38:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.225+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef74003a50 con 0x7fef8006e990 2023-06-09T04:38:55.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.225+0000 7fef677fe700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fef6c06ace0 0x7fef6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.225+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef74088960 con 0x7fef8006e990 2023-06-09T04:38:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.225+0000 7fef7e59c700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fef6c06ace0 0x7fef6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.226+0000 7fef7e59c700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fef6c06ace0 0x7fef6c06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef800af140 tx=0x7fef70008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.230+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef74053aa0 con 0x7fef8006e990 2023-06-09T04:38:55.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.426+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef800d0420 con 0x7fef8006e990 2023-06-09T04:38:55.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.427+0000 7fef677fe700 1 -- 172.21.15.26:0/4230365917 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef74017020 con 0x7fef8006e990 2023-06-09T04:38:55.428 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fef6c06ace0 msgr2=0x7fef6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fef6c06ace0 0x7fef6c06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef800af140 tx=0x7fef70008030 comp rx=0 tx=0).stop 2023-06-09T04:38:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 msgr2=0x7fef800b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 0x7fef800b4a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c4d0 tx=0x7fef7400c890 comp rx=0 tx=0).stop 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 shutdown_connections 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef8015c6e0 0x7fef800c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fef6c06ace0 0x7fef6c06d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef8006e990 0x7fef800b4a30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 --2- 172.21.15.26:0/4230365917 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fef800aed50 0x7fef80149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 >> 172.21.15.26:0/4230365917 conn(0x7fef80098a30 msgr2=0x7fef800ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 shutdown_connections 2023-06-09T04:38:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.429+0000 7fef85053700 1 -- 172.21.15.26:0/4230365917 wait complete. 2023-06-09T04:38:55.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:55.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.568+0000 7f02e87de700 1 Processor -- start 2023-06-09T04:38:55.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.568+0000 7f02e87de700 1 -- start start 2023-06-09T04:38:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e87de700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a310 0x7f02e00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e87de700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02e0098ea0 0x7f02e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e87de700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00cd880 con 0x7f02e015a6e0 2023-06-09T04:38:55.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e87de700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00ce280 con 0x7f02e0098ea0 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e87de700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00acb20 con 0x7f02e015a310 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e6d7b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f02e0098ea0 0x7f02e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e5d79700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f02e015a6e0 0x7f02e00ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47980/0 (socket says 172.21.15.26:47980) 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.569+0000 7f02e5d79700 1 -- 172.21.15.26:0/1121024495 learned_addr learned my addr 172.21.15.26:0/1121024495 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e657a700 1 --2- 172.21.15.26:0/1121024495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a310 0x7f02e00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e6d7b700 1 -- 172.21.15.26:0/1121024495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a310 msgr2=0x7f02e00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:55.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e6d7b700 1 --2- 172.21.15.26:0/1121024495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a310 0x7f02e00cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e6d7b700 1 -- 172.21.15.26:0/1121024495 >> v1:172.21.15.26:6789/0 conn(0x7f02e015a6e0 legacy=0x7f02e00ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e5578700 1 -- 172.21.15.26:0/1121024495 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831340250 0 0) 0x7f02e00cd880 con 0x7f02e015a6e0 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e6d7b700 1 -- 172.21.15.26:0/1121024495 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00cdb60 con 0x7f02e0098ea0 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e6d7b700 1 --2- 172.21.15.26:0/1121024495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e0098ea0 0x7f02e0069db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009d90 tx=0x7f02d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391a0550523e78a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e5578700 1 -- 172.21.15.26:0/1121024495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800e070 con 0x7f02e0098ea0 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e5578700 1 -- 172.21.15.26:0/1121024495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800bbd0 con 0x7f02e0098ea0 2023-06-09T04:38:55.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.570+0000 7f02e5578700 1 -- 172.21.15.26:0/1121024495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8012430 con 0x7f02e0098ea0 2023-06-09T04:38:55.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 -- 172.21.15.26:0/1121024495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e0098ea0 msgr2=0x7f02e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 --2- 172.21.15.26:0/1121024495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e0098ea0 0x7f02e0069db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009d90 tx=0x7f02d800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 -- 172.21.15.26:0/1121024495 shutdown_connections 2023-06-09T04:38:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 --2- 172.21.15.26:0/1121024495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e0098ea0 0x7f02e0069db0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 --2- 172.21.15.26:0/1121024495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a310 0x7f02e00cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 -- 172.21.15.26:0/1121024495 >> 172.21.15.26:0/1121024495 conn(0x7f02e0098a30 msgr2=0x7f02e00cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 -- 172.21.15.26:0/1121024495 shutdown_connections 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.571+0000 7f02e87de700 1 -- 172.21.15.26:0/1121024495 wait complete. 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.572+0000 7f02e87de700 1 Processor -- start 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.572+0000 7f02e87de700 1 -- start start 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e87de700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02e0098ea0 0x7f02e00c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e87de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 0x7f02e00c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e87de700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a6e0 0x7f02e015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e87de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0146730 con 0x7f02e015a310 2023-06-09T04:38:55.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e87de700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c4b50 con 0x7f02e0098ea0 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e87de700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c3f40 con 0x7f02e015a6e0 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.573+0000 7f02e5d79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 0x7f02e00c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 0x7f02e00c3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39130/0 (socket says 172.21.15.26:39130) 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 -- 172.21.15.26:0/476287759 learned_addr learned my addr 172.21.15.26:0/476287759 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e657a700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02e0098ea0 0x7f02e00c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e6d7b700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a6e0 0x7f02e015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 -- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a6e0 msgr2=0x7f02e015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a6e0 0x7f02e015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 -- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02e0098ea0 msgr2=0x7f02e00c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02e0098ea0 0x7f02e00c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 -- 172.21.15.26:0/476287759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009a70 con 0x7f02e015a310 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e5d79700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 0x7f02e00c3830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0011e0 tx=0x7f02dc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc004c80 con 0x7f02e015a310 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc004e00 con 0x7f02e015a310 2023-06-09T04:38:55.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e00c4220 con 0x7f02e015a310 2023-06-09T04:38:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc007310 con 0x7f02e015a310 2023-06-09T04:38:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.574+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e00c47e0 con 0x7f02e015a310 2023-06-09T04:38:55.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.575+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e0067180 con 0x7f02e015a310 2023-06-09T04:38:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.576+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02dc007470 con 0x7f02e015a310 2023-06-09T04:38:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.576+0000 7f02d6ffd700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f02c406ace0 0x7f02c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.576+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02dc0897f0 con 0x7f02e015a310 2023-06-09T04:38:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.577+0000 7f02e657a700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f02c406ace0 0x7f02c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.577+0000 7f02e657a700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f02c406ace0 0x7f02c406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02d0006fd0 tx=0x7f02d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.580+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02dc054980 con 0x7f02e015a310 2023-06-09T04:38:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.775+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02e006d180 con 0x7f02e015a310 2023-06-09T04:38:55.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.775+0000 7f02d6ffd700 1 -- 172.21.15.26:0/476287759 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02dc057fa0 con 0x7f02e015a310 2023-06-09T04:38:55.777 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.777+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f02c406ace0 msgr2=0x7f02c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.777+0000 7f02e87de700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f02c406ace0 0x7f02c406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02d0006fd0 tx=0x7f02d0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.777+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 msgr2=0x7f02e00c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.777+0000 7f02e87de700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 0x7f02e00c3830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0011e0 tx=0x7f02dc00cae0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 shutdown_connections 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f02e015a6e0 0x7f02e015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02e0098ea0 0x7f02e00c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f02c406ace0 0x7f02c406d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 --2- 172.21.15.26:0/476287759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e015a310 0x7f02e00c3830 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 >> 172.21.15.26:0/476287759 conn(0x7f02e0098a30 msgr2=0x7f02e006e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 shutdown_connections 2023-06-09T04:38:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.778+0000 7f02e87de700 1 -- 172.21.15.26:0/476287759 wait complete. 2023-06-09T04:38:55.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:55.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.917+0000 7f01636be700 1 Processor -- start 2023-06-09T04:38:55.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.917+0000 7f01636be700 1 -- start start 2023-06-09T04:38:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.918+0000 7f01636be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f015c15c6e0 0x7f015c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f01636be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c06f190 con 0x7f015c098e30 2023-06-09T04:38:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f01636be700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c06e440 con 0x7f015c06e990 2023-06-09T04:38:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f01636be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c0ce500 con 0x7f015c15c6e0 2023-06-09T04:38:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f015c15c6e0 0x7f015c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f015c15c6e0 0x7f015c0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39136/0 (socket says 172.21.15.26:39136) 2023-06-09T04:38:55.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f0161c5b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f015c098e30 0x7f015c0cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47998/0 (socket says 172.21.15.26:47998) 2023-06-09T04:38:55.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 -- 172.21.15.26:0/1882411185 learned_addr learned my addr 172.21.15.26:0/1882411185 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 -- 172.21.15.26:0/1882411185 >> v1:172.21.15.104:6789/0 conn(0x7f015c06e990 legacy=0x7f015c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 -- 172.21.15.26:0/1882411185 >> v1:172.21.15.26:6789/0 conn(0x7f015c098e30 legacy=0x7f015c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f0153fff700 1 -- 172.21.15.26:0/1882411185 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036502924 0 0) 0x7f015c06f190 con 0x7f015c098e30 2023-06-09T04:38:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 -- 172.21.15.26:0/1882411185 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c06e690 con 0x7f015c15c6e0 2023-06-09T04:38:55.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f016145a700 1 --2- 172.21.15.26:0/1882411185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c15c6e0 0x7f015c0ae640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f014c006fd0 tx=0x7f014c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5fc5b27fdae379 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f0153fff700 1 -- 172.21.15.26:0/1882411185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c005e30 con 0x7f015c15c6e0 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f0153fff700 1 -- 172.21.15.26:0/1882411185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c004030 con 0x7f015c15c6e0 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.919+0000 7f0153fff700 1 -- 172.21.15.26:0/1882411185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0043e0 con 0x7f015c15c6e0 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 -- 172.21.15.26:0/1882411185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c15c6e0 msgr2=0x7f015c0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 --2- 172.21.15.26:0/1882411185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c15c6e0 0x7f015c0ae640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f014c006fd0 tx=0x7f014c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 -- 172.21.15.26:0/1882411185 shutdown_connections 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 --2- 172.21.15.26:0/1882411185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c15c6e0 0x7f015c0ae640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 -- 172.21.15.26:0/1882411185 >> 172.21.15.26:0/1882411185 conn(0x7f015c098a30 msgr2=0x7f015c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 -- 172.21.15.26:0/1882411185 shutdown_connections 2023-06-09T04:38:55.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.920+0000 7f01636be700 1 -- 172.21.15.26:0/1882411185 wait complete. 2023-06-09T04:38:55.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.921+0000 7f01636be700 1 Processor -- start 2023-06-09T04:38:55.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.921+0000 7f01636be700 1 -- start start 2023-06-09T04:38:55.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f01636be700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f015c06e990 0x7f015c0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f01636be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 0x7f015c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f01636be700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f015c15c6e0 0x7f015c0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f01636be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0c3310 con 0x7f015c098e30 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f01636be700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0c5ee0 con 0x7f015c15c6e0 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f01636be700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0c6180 con 0x7f015c06e990 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 0x7f015c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 0x7f015c15a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39144/0 (socket says 172.21.15.26:39144) 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 -- 172.21.15.26:0/884392545 learned_addr learned my addr 172.21.15.26:0/884392545 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:55.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f016145a700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f015c06e990 0x7f015c0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0161c5b700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f015c15c6e0 0x7f015c0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 -- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f015c06e990 msgr2=0x7f015c0c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f015c06e990 0x7f015c0c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 -- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f015c15c6e0 msgr2=0x7f015c0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f015c15c6e0 0x7f015c0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0160c59700 1 -- 172.21.15.26:0/884392545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c009500 con 0x7f015c098e30 2023-06-09T04:38:55.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f0161c5b700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f015c15c6e0 0x7f015c0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.922+0000 7f016145a700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f015c06e990 0x7f015c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.923+0000 7f0160c59700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 0x7f015c15a6b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f015800c450 tx=0x7f015800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.923+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01580052d0 con 0x7f015c098e30 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.923+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158005430 con 0x7f015c098e30 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.923+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c0c6460 con 0x7f015c098e30 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.923+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01580038c0 con 0x7f015c098e30 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.923+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c0c3840 con 0x7f015c098e30 2023-06-09T04:38:55.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.924+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c067180 con 0x7f015c098e30 2023-06-09T04:38:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.924+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0158003a20 con 0x7f015c098e30 2023-06-09T04:38:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.925+0000 7f0151ffb700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f014006ace0 0x7f014006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.925+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01580888e0 con 0x7f015c098e30 2023-06-09T04:38:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.925+0000 7f016145a700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f014006ace0 0x7f014006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.926+0000 7f016145a700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f014006ace0 0x7f014006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f014c014040 tx=0x7f014c008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:55.929+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0158053990 con 0x7f015c098e30 2023-06-09T04:38:56.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.127+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f015c0ce6f0 con 0x7f015c098e30 2023-06-09T04:38:56.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.128+0000 7f0151ffb700 1 -- 172.21.15.26:0/884392545 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0158017020 con 0x7f015c098e30 2023-06-09T04:38:56.129 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:56.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f014006ace0 msgr2=0x7f014006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f014006ace0 0x7f014006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f014c014040 tx=0x7f014c008070 comp rx=0 tx=0).stop 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 msgr2=0x7f015c15a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 0x7f015c15a6b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f015800c450 tx=0x7f015800c810 comp rx=0 tx=0).stop 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 shutdown_connections 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f015c15c6e0 0x7f015c0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f015c06e990 0x7f015c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f014006ace0 0x7f014006d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 --2- 172.21.15.26:0/884392545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f015c098e30 0x7f015c15a6b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 >> 172.21.15.26:0/884392545 conn(0x7f015c098a30 msgr2=0x7f015c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:56.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 shutdown_connections 2023-06-09T04:38:56.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.130+0000 7f01636be700 1 -- 172.21.15.26:0/884392545 wait complete. 2023-06-09T04:38:56.144 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:56.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.268+0000 7f595ee4b700 1 Processor -- start 2023-06-09T04:38:56.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.268+0000 7f595ee4b700 1 -- start start 2023-06-09T04:38:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595ee4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59580ae920 0x7f595806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595ee4b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580ce380 con 0x7f5958069db0 2023-06-09T04:38:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595ee4b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580ce660 con 0x7f59580cdda0 2023-06-09T04:38:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595ee4b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580ca670 con 0x7f59580ae920 2023-06-09T04:38:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595d3e8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59580ae920 0x7f595806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595cbe7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5958069db0 0x7f595806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48008/0 (socket says 172.21.15.26:48008) 2023-06-09T04:38:56.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595cbe7700 1 -- 172.21.15.26:0/2646236102 learned_addr learned my addr 172.21.15.26:0/2646236102 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f59577fe700 1 -- 172.21.15.26:0/2646236102 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880548403 0 0) 0x7f59580ce380 con 0x7f5958069db0 2023-06-09T04:38:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f59577fe700 1 -- 172.21.15.26:0/2646236102 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59480035b0 con 0x7f5958069db0 2023-06-09T04:38:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595d3e8700 1 -- 172.21.15.26:0/2646236102 >> v1:172.21.15.104:6789/0 conn(0x7f59580cdda0 legacy=0x7f595806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595d3e8700 1 -- 172.21.15.26:0/2646236102 >> v1:172.21.15.26:6789/0 conn(0x7f5958069db0 legacy=0x7f595806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595d3e8700 1 -- 172.21.15.26:0/2646236102 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580ce940 con 0x7f59580ae920 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.269+0000 7f595d3e8700 1 --2- 172.21.15.26:0/2646236102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f595806d5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5950009d90 tx=0x7f595000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b9a266b3c5b4b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f59577fe700 1 -- 172.21.15.26:0/2646236102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000e070 con 0x7f59580ae920 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f59577fe700 1 -- 172.21.15.26:0/2646236102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000bb20 con 0x7f59580ae920 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f59577fe700 1 -- 172.21.15.26:0/2646236102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950012430 con 0x7f59580ae920 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 -- 172.21.15.26:0/2646236102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 msgr2=0x7f595806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 --2- 172.21.15.26:0/2646236102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f595806d5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5950009d90 tx=0x7f595000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:56.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 -- 172.21.15.26:0/2646236102 shutdown_connections 2023-06-09T04:38:56.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 --2- 172.21.15.26:0/2646236102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f595806d5b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 -- 172.21.15.26:0/2646236102 >> 172.21.15.26:0/2646236102 conn(0x7f5958098b50 msgr2=0x7f59580cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:56.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 -- 172.21.15.26:0/2646236102 shutdown_connections 2023-06-09T04:38:56.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.270+0000 7f595ee4b700 1 -- 172.21.15.26:0/2646236102 wait complete. 2023-06-09T04:38:56.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.271+0000 7f595ee4b700 1 Processor -- start 2023-06-09T04:38:56.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 -- start start 2023-06-09T04:38:56.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5958069db0 0x7f59581505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f59581e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59580cdda0 0x7f59580b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581e5d40 con 0x7f59580ae920 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c6890 con 0x7f5958069db0 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f595ee4b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c6b70 con 0x7f59580cdda0 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f5957fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f59581e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f5957fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f59581e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39158/0 (socket says 172.21.15.26:39158) 2023-06-09T04:38:56.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.272+0000 7f5957fff700 1 -- 172.21.15.26:0/357774126 learned_addr learned my addr 172.21.15.26:0/357774126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f595d3e8700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59580cdda0 0x7f59580b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f595cbe7700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5958069db0 0x7f59581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f5957fff700 1 -- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59580cdda0 msgr2=0x7f59580b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f5957fff700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59580cdda0 0x7f59580b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f5957fff700 1 -- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5958069db0 msgr2=0x7f59581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f5957fff700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5958069db0 0x7f59581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f5957fff700 1 -- 172.21.15.26:0/357774126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009a70 con 0x7f59580ae920 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f595cbe7700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5958069db0 0x7f59581505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f5957fff700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f59581e5800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f594400c450 tx=0x7f594400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59440052d0 con 0x7f59580ae920 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5944005430 con 0x7f59580ae920 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580c6e50 con 0x7f59580ae920 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59440038c0 con 0x7f59580ae920 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.273+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59580c7410 con 0x7f59580ae920 2023-06-09T04:38:56.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.274+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59580708e0 con 0x7f59580ae920 2023-06-09T04:38:56.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.275+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5944003a20 con 0x7f59580ae920 2023-06-09T04:38:56.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.275+0000 7f59557fa700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f593c06ace0 0x7f593c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.275+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5944088820 con 0x7f59580ae920 2023-06-09T04:38:56.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.275+0000 7f595cbe7700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f593c06ace0 0x7f593c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.276+0000 7f595cbe7700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f593c06ace0 0x7f593c06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f594c0010e0 tx=0x7f594c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:56.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.279+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59440538d0 con 0x7f59580ae920 2023-06-09T04:38:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.492+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5958067180 con 0x7f59580ae920 2023-06-09T04:38:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.492+0000 7f59557fa700 1 -- 172.21.15.26:0/357774126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5944056ef0 con 0x7f59580ae920 2023-06-09T04:38:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f593c06ace0 msgr2=0x7f593c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f593c06ace0 0x7f593c06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f594c0010e0 tx=0x7f594c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 msgr2=0x7f59581e5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f59581e5800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f594400c450 tx=0x7f594400c810 comp rx=0 tx=0).stop 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 shutdown_connections 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59580cdda0 0x7f59580b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5958069db0 0x7f59581505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f593c06ace0 0x7f593c06d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 --2- 172.21.15.26:0/357774126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59580ae920 0x7f59581e5800 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 >> 172.21.15.26:0/357774126 conn(0x7f5958098b50 msgr2=0x7f595815e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:56.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 shutdown_connections 2023-06-09T04:38:56.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.494+0000 7f595ee4b700 1 -- 172.21.15.26:0/357774126 wait complete. 2023-06-09T04:38:56.497 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:38:56.507 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2023-06-09T04:38:56.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:56.508 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:56.557 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:56.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:38:56.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:56.558 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T04:38:56.589 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:38:56.590 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:56.607 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:38:56.607 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:56.664 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:56.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.828+0000 7f7089fdd700 1 Processor -- start 2023-06-09T04:38:56.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.828+0000 7f7089fdd700 1 -- start start 2023-06-09T04:38:56.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.828+0000 7f7089fdd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7084159080 0x7f70840c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.828+0000 7f7089fdd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70840ae760 0x7f70840ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.828+0000 7f7089fdd700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70840cd7a0 con 0x7f70840aecd0 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7089fdd700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7084099030 con 0x7f70840ae760 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7089fdd700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840cca60 con 0x7f7084159080 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7082ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70840ae760 0x7f70840ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7083fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70840aecd0 0x7f708415cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48026/0 (socket says 172.21.15.26:48026) 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7083fff700 1 -- 172.21.15.26:0/2733627173 learned_addr learned my addr 172.21.15.26:0/2733627173 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:56.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7082ffd700 1 -- 172.21.15.26:0/2733627173 >> v2:172.21.15.104:3300/0 conn(0x7f7084159080 msgr2=0x7f70840c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f70837fe700 1 --2- 172.21.15.26:0/2733627173 >> v2:172.21.15.104:3300/0 conn(0x7f7084159080 0x7f70840c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7082ffd700 1 --2- 172.21.15.26:0/2733627173 >> v2:172.21.15.104:3300/0 conn(0x7f7084159080 0x7f70840c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7082ffd700 1 -- 172.21.15.26:0/2733627173 >> v1:172.21.15.26:6789/0 conn(0x7f70840aecd0 legacy=0x7f708415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7082ffd700 1 -- 172.21.15.26:0/2733627173 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840ccd40 con 0x7f70840ae760 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f70827fc700 1 -- 172.21.15.26:0/2733627173 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205499947 0 0) 0x7f70840cd7a0 con 0x7f70840aecd0 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f70837fe700 1 --2- 172.21.15.26:0/2733627173 >> v2:172.21.15.104:3300/0 conn(0x7f7084159080 0x7f70840c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:56.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f7082ffd700 1 --2- 172.21.15.26:0/2733627173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70840ae760 0x7f70840ca350 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7084070d70 tx=0x7f706c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02aed9fc40506ae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:56.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f70827fc700 1 -- 172.21.15.26:0/2733627173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011830 con 0x7f70840ae760 2023-06-09T04:38:56.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f70827fc700 1 -- 172.21.15.26:0/2733627173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c011990 con 0x7f70840ae760 2023-06-09T04:38:56.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.829+0000 7f70827fc700 1 -- 172.21.15.26:0/2733627173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011d20 con 0x7f70840ae760 2023-06-09T04:38:56.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 -- 172.21.15.26:0/2733627173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70840ae760 msgr2=0x7f70840ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 --2- 172.21.15.26:0/2733627173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70840ae760 0x7f70840ca350 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7084070d70 tx=0x7f706c009b20 comp rx=0 tx=0).stop 2023-06-09T04:38:56.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 -- 172.21.15.26:0/2733627173 shutdown_connections 2023-06-09T04:38:56.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 --2- 172.21.15.26:0/2733627173 >> v2:172.21.15.104:3300/0 conn(0x7f7084159080 0x7f70840c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 --2- 172.21.15.26:0/2733627173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70840ae760 0x7f70840ca350 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 -- 172.21.15.26:0/2733627173 >> 172.21.15.26:0/2733627173 conn(0x7f7084098b50 msgr2=0x7f70840cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 -- 172.21.15.26:0/2733627173 shutdown_connections 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.830+0000 7f7089fdd700 1 -- 172.21.15.26:0/2733627173 wait complete. 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.832+0000 7f7089fdd700 1 Processor -- start 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.832+0000 7f7089fdd700 1 -- start start 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7089fdd700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f70840ae760 0x7f70840c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7089fdd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70840aecd0 0x7f70840c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7089fdd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 0x7f70841ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7089fdd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840c5a00 con 0x7f7084159080 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7089fdd700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840c57d0 con 0x7f70840aecd0 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7089fdd700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70841ec4f0 con 0x7f70840ae760 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 0x7f70841ebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 0x7f70841ebfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39174/0 (socket says 172.21.15.26:39174) 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 -- 172.21.15.26:0/1034406373 learned_addr learned my addr 172.21.15.26:0/1034406373 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:56.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7082ffd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70840aecd0 0x7f70840c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f70837fe700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f70840ae760 0x7f70840c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 -- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f70840ae760 msgr2=0x7f70840c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f70840ae760 0x7f70840c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 -- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70840aecd0 msgr2=0x7f70840c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70840aecd0 0x7f70840c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 -- 172.21.15.26:0/1034406373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0094a0 con 0x7f7084159080 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f7083fff700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 0x7f70841ebfb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f707c002210 tx=0x7f707c00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:56.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.833+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0070d0 con 0x7f7084159080 2023-06-09T04:38:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.834+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c007230 con 0x7f7084159080 2023-06-09T04:38:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.834+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70840c3e80 con 0x7f7084159080 2023-06-09T04:38:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.834+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0075c0 con 0x7f7084159080 2023-06-09T04:38:56.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.834+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70840c4120 con 0x7f7084159080 2023-06-09T04:38:56.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.834+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70840d0760 con 0x7f7084159080 2023-06-09T04:38:56.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.835+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f707c007720 con 0x7f7084159080 2023-06-09T04:38:56.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.835+0000 7f707bfff700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f706406ad10 0x7f706406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:56.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.836+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f707c08c4d0 con 0x7f7084159080 2023-06-09T04:38:56.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.836+0000 7f70837fe700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f706406ad10 0x7f706406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:56.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.836+0000 7f70837fe700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f706406ad10 0x7f706406d1c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f708409d700 tx=0x7f7074008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:56.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:56.840+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f707c057580 con 0x7f7084159080 2023-06-09T04:38:57.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.039+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7084067180 con 0x7f7084159080 2023-06-09T04:38:57.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.040+0000 7f707bfff700 1 -- 172.21.15.26:0/1034406373 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18209 (secure 0 0 0) 0x7f707c0079d0 con 0x7f7084159080 2023-06-09T04:38:57.041 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:57.042 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:11.905000+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f706406ad10 msgr2=0x7f706406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f706406ad10 0x7f706406d1c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f708409d700 tx=0x7f7074008040 comp rx=0 tx=0).stop 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 msgr2=0x7f70841ebfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 0x7f70841ebfb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f707c002210 tx=0x7f707c00c550 comp rx=0 tx=0).stop 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 shutdown_connections 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f706406ad10 0x7f706406d1c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7084159080 0x7f70841ebfb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f70840ae760 0x7f70840c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 --2- 172.21.15.26:0/1034406373 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70840aecd0 0x7f70840c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 >> 172.21.15.26:0/1034406373 conn(0x7f7084098b50 msgr2=0x7f70840acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 shutdown_connections 2023-06-09T04:38:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.042+0000 7f7089fdd700 1 -- 172.21.15.26:0/1034406373 wait complete. 2023-06-09T04:38:57.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:57.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.184+0000 7f1a7bbfb700 1 Processor -- start 2023-06-09T04:38:57.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.184+0000 7f1a7bbfb700 1 -- start start 2023-06-09T04:38:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a7bbfb700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1a740aed90 0x7f1a740c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a7bbfb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a7406da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a7bbfb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a74159880 con 0x7f1a740ca370 2023-06-09T04:38:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a7bbfb700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740ca810 con 0x7f1a740aed90 2023-06-09T04:38:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a7bbfb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740cda30 con 0x7f1a740cecb0 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a79196700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1a740ca370 0x7f1a740ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48038/0 (socket says 172.21.15.26:48038) 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a79196700 1 -- 172.21.15.26:0/1415183380 learned_addr learned my addr 172.21.15.26:0/1415183380 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a79997700 1 --2- 172.21.15.26:0/1415183380 >> v2:172.21.15.104:3300/0 conn(0x7f1a740aed90 0x7f1a740c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.185+0000 7f1a7a198700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a7406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a78995700 1 -- 172.21.15.26:0/1415183380 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981674062 0 0) 0x7f1a74159880 con 0x7f1a740ca370 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a78995700 1 -- 172.21.15.26:0/1415183380 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a600035b0 con 0x7f1a740ca370 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a79997700 1 -- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 msgr2=0x7f1a7406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a79997700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a7406da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a79997700 1 -- 172.21.15.26:0/1415183380 >> v1:172.21.15.26:6789/0 conn(0x7f1a740ca370 legacy=0x7f1a740ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a79997700 1 -- 172.21.15.26:0/1415183380 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7406cff0 con 0x7f1a740aed90 2023-06-09T04:38:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a7a198700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a7406da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a79997700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740c9e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009850 tx=0x7f1a70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360ea0f41c981d47 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a78995700 1 -- 172.21.15.26:0/1415183380 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70005e30 con 0x7f1a740aed90 2023-06-09T04:38:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a78995700 1 -- 172.21.15.26:0/1415183380 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70006030 con 0x7f1a740aed90 2023-06-09T04:38:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.186+0000 7f1a78995700 1 -- 172.21.15.26:0/1415183380 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700063c0 con 0x7f1a740aed90 2023-06-09T04:38:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 msgr2=0x7f1a740c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740c9e30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009850 tx=0x7f1a70009b60 comp rx=0 tx=0).stop 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/1415183380 shutdown_connections 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a7406da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/1415183380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740c9e30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/1415183380 >> 172.21.15.26:0/1415183380 conn(0x7f1a74098a30 msgr2=0x7f1a740cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/1415183380 shutdown_connections 2023-06-09T04:38:57.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.187+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/1415183380 wait complete. 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.188+0000 7f1a7bbfb700 1 Processor -- start 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.188+0000 7f1a7bbfb700 1 -- start start 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7bbfb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7bbfb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 0x7f1a741f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7bbfb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a741e3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7bbfb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740ac950 con 0x7f1a740ca370 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7bbfb700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a741e40f0 con 0x7f1a740aed90 2023-06-09T04:38:57.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7bbfb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a741e43d0 con 0x7f1a740cecb0 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 0x7f1a741f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 0x7f1a741f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39186/0 (socket says 172.21.15.26:39186) 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 -- 172.21.15.26:0/2286738159 learned_addr learned my addr 172.21.15.26:0/2286738159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79997700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a7a198700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a741e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 -- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 msgr2=0x7f1a741e3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a741e3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 -- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 msgr2=0x7f1a740ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 -- 172.21.15.26:0/2286738159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c009a70 con 0x7f1a740ca370 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.189+0000 7f1a79196700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 0x7f1a741f1500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a68001eb0 tx=0x7f1a6800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.190+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800cea0 con 0x7f1a740ca370 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.190+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68005d70 con 0x7f1a740ca370 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.190+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a70009430 con 0x7f1a740ca370 2023-06-09T04:38:57.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.190+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a740b4550 con 0x7f1a740ca370 2023-06-09T04:38:57.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.190+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68001230 con 0x7f1a740ca370 2023-06-09T04:38:57.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.191+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a740b4790 con 0x7f1a740ca370 2023-06-09T04:38:57.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.191+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a680072d0 con 0x7f1a740ca370 2023-06-09T04:38:57.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.192+0000 7f1a667fc700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f1a5806ace0 0x7f1a5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.192+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a680886c0 con 0x7f1a740ca370 2023-06-09T04:38:57.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.192+0000 7f1a79997700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f1a5806ace0 0x7f1a5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.192+0000 7f1a79997700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f1a5806ace0 0x7f1a5806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009ba0 tx=0x7f1a70008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.196+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a740b4790 con 0x7f1a740ca370 2023-06-09T04:38:57.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.393+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a740b4790 con 0x7f1a740ca370 2023-06-09T04:38:57.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.394+0000 7f1a667fc700 1 -- 172.21.15.26:0/2286738159 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a740b4790 con 0x7f1a740ca370 2023-06-09T04:38:57.395 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.395+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f1a5806ace0 msgr2=0x7f1a5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.395+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f1a5806ace0 0x7f1a5806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009ba0 tx=0x7f1a70008070 comp rx=0 tx=0).stop 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.395+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 msgr2=0x7f1a741f1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.395+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 0x7f1a741f1500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a68001eb0 tx=0x7f1a6800c7b0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.395+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 shutdown_connections 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.395+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a740cecb0 0x7f1a741e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.396+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a740aed90 0x7f1a740ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.396+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f1a5806ace0 0x7f1a5806d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.396+0000 7f1a7bbfb700 1 --2- 172.21.15.26:0/2286738159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a740ca370 0x7f1a741f1500 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.396+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 >> 172.21.15.26:0/2286738159 conn(0x7f1a74098a30 msgr2=0x7f1a74158950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:57.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.396+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 shutdown_connections 2023-06-09T04:38:57.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.396+0000 7f1a7bbfb700 1 -- 172.21.15.26:0/2286738159 wait complete. 2023-06-09T04:38:57.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.536+0000 7f59f0ce5700 1 Processor -- start 2023-06-09T04:38:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.536+0000 7f59f0ce5700 1 -- start start 2023-06-09T04:38:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59f0ce5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0aed90 0x7f59ec0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59f0ce5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f59ec0cecb0 0x7f59ec06da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59f0ce5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec159880 con 0x7f59ec0ca370 2023-06-09T04:38:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59f0ce5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec0cda30 con 0x7f59ec0cecb0 2023-06-09T04:38:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59f0ce5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0ca7e0 con 0x7f59ec0aed90 2023-06-09T04:38:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59ead9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f59ec0cecb0 0x7f59ec06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0aed90 0x7f59ec0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59ead9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f59ec0cecb0 0x7f59ec06da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:46316/0 (socket says 172.21.15.26:46316) 2023-06-09T04:38:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59ead9d700 1 -- 172.21.15.26:0/3337440092 learned_addr learned my addr 172.21.15.26:0/3337440092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:57.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.537+0000 7f59e9d9b700 1 --1- 172.21.15.26:0/3337440092 >> v1:172.21.15.104:6789/0 conn(0x7f59ec0ca370 0x7f59ec0ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:46964/0 (socket says 172.21.15.26:46964) 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59ead9d700 1 -- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0aed90 msgr2=0x7f59ec0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59ead9d700 1 --2- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0aed90 0x7f59ec0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59ead9d700 1 -- 172.21.15.26:0/3337440092 >> v1:172.21.15.104:6789/0 conn(0x7f59ec0ca370 legacy=0x7f59ec0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59ead9d700 1 -- 172.21.15.26:0/3337440092 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec06cff0 con 0x7f59ec0cecb0 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59e959a700 1 -- 172.21.15.26:0/3337440092 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468673292 0 0) 0x7f59ec159880 con 0x7f59ec0ca370 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59ead9d700 1 --2- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0cecb0 0x7f59ec06da60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59e400d180 tx=0x7f59e400d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a9838f375276a98 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59e959a700 1 -- 172.21.15.26:0/3337440092 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4010070 con 0x7f59ec0cecb0 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59e959a700 1 -- 172.21.15.26:0/3337440092 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400dd00 con 0x7f59ec0cecb0 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59e959a700 1 -- 172.21.15.26:0/3337440092 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400b310 con 0x7f59ec0cecb0 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0cecb0 msgr2=0x7f59ec06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.538+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0cecb0 0x7f59ec06da60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59e400d180 tx=0x7f59e400d490 comp rx=0 tx=0).stop 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.539+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3337440092 shutdown_connections 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.539+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0cecb0 0x7f59ec06da60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.539+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3337440092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0aed90 0x7f59ec0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.539+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3337440092 >> 172.21.15.26:0/3337440092 conn(0x7f59ec098a30 msgr2=0x7f59ec0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.539+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3337440092 shutdown_connections 2023-06-09T04:38:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.539+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3337440092 wait complete. 2023-06-09T04:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.540+0000 7f59f0ce5700 1 Processor -- start 2023-06-09T04:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.540+0000 7f59f0ce5700 1 -- start start 2023-06-09T04:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59f0ce5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 0x7f59ec0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59f0ce5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0ca370 0x7f59ec0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59f0ce5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0cecb0 0x7f59ec0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59f0ce5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0b5570 con 0x7f59ec0aed90 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59f0ce5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec158290 con 0x7f59ec0ca370 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59f0ce5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0b3950 con 0x7f59ec0cecb0 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 0x7f59ec0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 0x7f59ec0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39198/0 (socket says 172.21.15.26:39198) 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 -- 172.21.15.26:0/3625385134 learned_addr learned my addr 172.21.15.26:0/3625385134 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59e9d9b700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0ca370 0x7f59ec0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ead9d700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0cecb0 0x7f59ec0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 -- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0cecb0 msgr2=0x7f59ec0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0cecb0 0x7f59ec0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 -- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0ca370 msgr2=0x7f59ec0b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0ca370 0x7f59ec0b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 -- 172.21.15.26:0/3625385134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e400bd40 con 0x7f59ec0aed90 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59ea59c700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 0x7f59ec0b3300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f59e000e900 tx=0x7f59e000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.541+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0009650 con 0x7f59ec0aed90 2023-06-09T04:38:57.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.542+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e000c850 con 0x7f59ec0aed90 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.542+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec0b3c30 con 0x7f59ec0aed90 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.542+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000cbc0 con 0x7f59ec0aed90 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.542+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec0b41f0 con 0x7f59ec0aed90 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.542+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec067180 con 0x7f59ec0aed90 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.543+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59e000cd20 con 0x7f59ec0aed90 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.543+0000 7f59daffd700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59cc06ace0 0x7f59cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.543+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59e0089890 con 0x7f59ec0aed90 2023-06-09T04:38:57.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.544+0000 7f59e9d9b700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59cc06ace0 0x7f59cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.544+0000 7f59e9d9b700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59cc06ace0 0x7f59cc06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0c6120 tx=0x7f59dc007c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.548+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59e0054950 con 0x7f59ec0aed90 2023-06-09T04:38:57.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.743+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59ec0cbb90 con 0x7f59ec0aed90 2023-06-09T04:38:57.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.743+0000 7f59daffd700 1 -- 172.21.15.26:0/3625385134 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59e0057f70 con 0x7f59ec0aed90 2023-06-09T04:38:57.745 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59cc06ace0 msgr2=0x7f59cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59cc06ace0 0x7f59cc06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0c6120 tx=0x7f59dc007c90 comp rx=0 tx=0).stop 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 msgr2=0x7f59ec0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 0x7f59ec0b3300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f59e000e900 tx=0x7f59e000ecc0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 shutdown_connections 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f59ec0cecb0 0x7f59ec0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f59cc06ace0 0x7f59cc06d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59ec0aed90 0x7f59ec0b3300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 --2- 172.21.15.26:0/3625385134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59ec0ca370 0x7f59ec0b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 >> 172.21.15.26:0/3625385134 conn(0x7f59ec098a30 msgr2=0x7f59ec0ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:57.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 shutdown_connections 2023-06-09T04:38:57.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.745+0000 7f59f0ce5700 1 -- 172.21.15.26:0/3625385134 wait complete. 2023-06-09T04:38:57.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.885+0000 7fa801d56700 1 Processor -- start 2023-06-09T04:38:57.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.885+0000 7fa801d56700 1 -- start start 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa801d56700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a310 0x7fa7fc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa801d56700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc0cd880 con 0x7fa7fc098ea0 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa801d56700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc0cdb60 con 0x7fa7fc15a6e0 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa801d56700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0ce280 con 0x7fa7fc15a310 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa7fbfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa7fc098ea0 0x7fa7fc069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48066/0 (socket says 172.21.15.26:48066) 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa7fbfff700 1 -- 172.21.15.26:0/1235038943 learned_addr learned my addr 172.21.15.26:0/1235038943 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:57.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa7fb7fe700 1 --2- 172.21.15.26:0/1235038943 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a310 0x7fa7fc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487893404 0 0) 0x7fa7fc0cd880 con 0x7fa7fc098ea0 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.886+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e40035b0 con 0x7fa7fc098ea0 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913698737 0 0) 0x7fa7fc0cdb60 con 0x7fa7fc15a6e0 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7fc0cd880 con 0x7fa7fc15a6e0 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fb7fe700 1 -- 172.21.15.26:0/1235038943 >> v1:172.21.15.104:6789/0 conn(0x7fa7fc15a6e0 legacy=0x7fa7fc0ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fb7fe700 1 -- 172.21.15.26:0/1235038943 >> v1:172.21.15.26:6789/0 conn(0x7fa7fc098ea0 legacy=0x7fa7fc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fb7fe700 1 -- 172.21.15.26:0/1235038943 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc06e190 con 0x7fa7fc15a310 2023-06-09T04:38:57.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fb7fe700 1 --2- 172.21.15.26:0/1235038943 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a310 0x7fa7fc0cede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009850 tx=0x7fa7ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b314bf9d63b078 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec005e30 con 0x7fa7fc15a310 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec006030 con 0x7fa7fc15a310 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.887+0000 7fa7fa7fc700 1 -- 172.21.15.26:0/1235038943 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0063a0 con 0x7fa7fc15a310 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 -- 172.21.15.26:0/1235038943 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a310 msgr2=0x7fa7fc0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 --2- 172.21.15.26:0/1235038943 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a310 0x7fa7fc0cede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009850 tx=0x7fa7ec009b60 comp rx=0 tx=0).stop 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 -- 172.21.15.26:0/1235038943 shutdown_connections 2023-06-09T04:38:57.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 --2- 172.21.15.26:0/1235038943 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a310 0x7fa7fc0cede0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 -- 172.21.15.26:0/1235038943 >> 172.21.15.26:0/1235038943 conn(0x7fa7fc098a30 msgr2=0x7fa7fc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 -- 172.21.15.26:0/1235038943 shutdown_connections 2023-06-09T04:38:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.888+0000 7fa801d56700 1 -- 172.21.15.26:0/1235038943 wait complete. 2023-06-09T04:38:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.889+0000 7fa801d56700 1 Processor -- start 2023-06-09T04:38:57.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.889+0000 7fa801d56700 1 -- start start 2023-06-09T04:38:57.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa801d56700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc098ea0 0x7fa7fc0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa801d56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 0x7fa7fc152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa801d56700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a6e0 0x7fa7fc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa801d56700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1526a0 con 0x7fa7fc15a310 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa801d56700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b4060 con 0x7fa7fc098ea0 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa801d56700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b4340 con 0x7fa7fc15a6e0 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.890+0000 7fa7faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 0x7fa7fc152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 0x7fa7fc152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39214/0 (socket says 172.21.15.26:39214) 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 -- 172.21.15.26:0/3794704484 learned_addr learned my addr 172.21.15.26:0/3794704484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7fb7fe700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc098ea0 0x7fa7fc0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7fbfff700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a6e0 0x7fa7fc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 -- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a6e0 msgr2=0x7fa7fc152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a6e0 0x7fa7fc152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 -- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc098ea0 msgr2=0x7fa7fc0c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc098ea0 0x7fa7fc0c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 -- 172.21.15.26:0/3794704484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec009430 con 0x7fa7fc15a310 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7fbfff700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a6e0 0x7fa7fc152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7faffd700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 0x7fa7fc152850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c500 tx=0x7fa7f000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.896 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00052d0 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0005430 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc0b4620 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00038c0 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.891+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc0b4be0 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.892+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc067180 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.893+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7f0003a20 con 0x7fa7fc15a310 2023-06-09T04:38:57.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.893+0000 7fa7e3fff700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa7e806ace0 0x7fa7e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.893+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7f0088950 con 0x7fa7fc15a310 2023-06-09T04:38:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.893+0000 7fa7fb7fe700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa7e806ace0 0x7fa7e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:57.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.894+0000 7fa7fb7fe700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa7e806ace0 0x7fa7e806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc065f90 tx=0x7fa7ec008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:57.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:57.898+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7f0053a00 con 0x7fa7fc15a310 2023-06-09T04:38:58.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.095+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7fc0b4da0 con 0x7fa7fc15a310 2023-06-09T04:38:58.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.095+0000 7fa7e3fff700 1 -- 172.21.15.26:0/3794704484 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa7f0057020 con 0x7fa7fc15a310 2023-06-09T04:38:58.096 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:38:58.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa7e806ace0 msgr2=0x7fa7e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa7e806ace0 0x7fa7e806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc065f90 tx=0x7fa7ec008070 comp rx=0 tx=0).stop 2023-06-09T04:38:58.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 msgr2=0x7fa7fc152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 0x7fa7fc152850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c500 tx=0x7fa7f000c810 comp rx=0 tx=0).stop 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 shutdown_connections 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa7fc15a6e0 0x7fa7fc152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc098ea0 0x7fa7fc0c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa7e806ace0 0x7fa7e806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 --2- 172.21.15.26:0/3794704484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7fc15a310 0x7fa7fc152850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 >> 172.21.15.26:0/3794704484 conn(0x7fa7fc098a30 msgr2=0x7fa7fc069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 shutdown_connections 2023-06-09T04:38:58.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.097+0000 7fa801d56700 1 -- 172.21.15.26:0/3794704484 wait complete. 2023-06-09T04:38:58.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:58.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.238+0000 7f4901994700 1 Processor -- start 2023-06-09T04:38:58.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.238+0000 7f4901994700 1 -- start start 2023-06-09T04:38:58.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.239+0000 7f4901994700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f48fc15c6e0 0x7f48fc0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.239+0000 7f4901994700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc06f190 con 0x7f48fc06e990 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.239+0000 7f4901994700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc06e440 con 0x7f48fc098e30 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.239+0000 7f4901994700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc0ce500 con 0x7f48fc15c6e0 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.239+0000 7f48fa7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f48fc06e990 0x7f48fc0cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48078/0 (socket says 172.21.15.26:48078) 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.239+0000 7f48fa7fc700 1 -- 172.21.15.26:0/2972089986 learned_addr learned my addr 172.21.15.26:0/2972089986 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 --2- 172.21.15.26:0/2972089986 >> v2:172.21.15.104:3300/0 conn(0x7f48fc15c6e0 0x7f48fc0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044649896 0 0) 0x7f48fc06f190 con 0x7f48fc06e990 2023-06-09T04:38:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e80035b0 con 0x7f48fc06e990 2023-06-09T04:38:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722167795 0 0) 0x7f48e80035b0 con 0x7f48fc06e990 2023-06-09T04:38:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 >> v2:172.21.15.104:3300/0 conn(0x7f48fc15c6e0 msgr2=0x7f48fc0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 --2- 172.21.15.26:0/2972089986 >> v2:172.21.15.104:3300/0 conn(0x7f48fc15c6e0 0x7f48fc0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 >> v1:172.21.15.104:6789/0 conn(0x7f48fc098e30 legacy=0x7f48fc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc06e690 con 0x7f48fc06e990 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f48ec001670 con 0x7f48fc06e990 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 >> v1:172.21.15.26:6789/0 conn(0x7f48fc06e990 legacy=0x7f48fc0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e8003a00 0x7f48e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48e8004850 0x7f48e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8005200 0x7f48e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0ce500 con 0x7f48e8003a00 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e800c110 con 0x7f48e8005200 2023-06-09T04:38:58.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e800c2d0 con 0x7f48e8004850 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e8003a00 0x7f48e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48fb7fe700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8005200 0x7f48e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48fa7fc700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48e8004850 0x7f48e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 -- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48e8004850 msgr2=0x7f48e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48e8004850 0x7f48e8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 -- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8005200 msgr2=0x7f48e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:58.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8005200 0x7f48e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 -- 172.21.15.26:0/2972089986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80035b0 con 0x7f48e8003a00 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48fb7fe700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8005200 0x7f48e800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48fb7fe700 1 -- 172.21.15.26:0/2972089986 reap_dead start 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.240+0000 7f48faffd700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e8003a00 0x7f48e8003e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b40 tx=0x7f48e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e9cbc6b0ddcbae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4005a20 con 0x7f48e8003a00 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e4005b80 con 0x7f48e8003a00 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f48f9ffb700 1 -- 172.21.15.26:0/2972089986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400e6c0 con 0x7f48e8003a00 2023-06-09T04:38:58.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 -- 172.21.15.26:0/2972089986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e8003a00 msgr2=0x7f48e8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e8003a00 0x7f48e8003e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b40 tx=0x7f48e8005880 comp rx=0 tx=0).stop 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 -- 172.21.15.26:0/2972089986 shutdown_connections 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 --2- 172.21.15.26:0/2972089986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e8003a00 0x7f48e8003e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 -- 172.21.15.26:0/2972089986 >> 172.21.15.26:0/2972089986 conn(0x7f48fc098a30 msgr2=0x7f48fc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 -- 172.21.15.26:0/2972089986 shutdown_connections 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.241+0000 7f4901994700 1 -- 172.21.15.26:0/2972089986 wait complete. 2023-06-09T04:38:58.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.242+0000 7f4901994700 1 Processor -- start 2023-06-09T04:38:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 -- start start 2023-06-09T04:38:58.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8003a00 0x7f48fc148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48fc14bdd0 0x7f48fc15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 0x7f48fc14b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc14baf0 con 0x7f48fc14b140 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc15d1d0 con 0x7f48e8003a00 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f4901994700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc15d4b0 con 0x7f48fc14bdd0 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f48fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 0x7f48fc14b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f48fb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 0x7f48fc14b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39236/0 (socket says 172.21.15.26:39236) 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.243+0000 7f48fb7fe700 1 -- 172.21.15.26:0/4193930667 learned_addr learned my addr 172.21.15.26:0/4193930667 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48faffd700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8003a00 0x7f48fc148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fa7fc700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48fc14bdd0 0x7f48fc15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fb7fe700 1 -- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48fc14bdd0 msgr2=0x7f48fc15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fb7fe700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48fc14bdd0 0x7f48fc15fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fb7fe700 1 -- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8003a00 msgr2=0x7f48fc148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fb7fe700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8003a00 0x7f48fc148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fb7fe700 1 -- 172.21.15.26:0/4193930667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc149290 con 0x7f48fc14b140 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48fb7fe700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 0x7f48fc14b5b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b5890 tx=0x7f48f400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4003c10 con 0x7f48fc14b140 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4003d70 con 0x7f48fc14b140 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc149570 con 0x7f48fc14b140 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005310 con 0x7f48fc14b140 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.244+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc15ff60 con 0x7f48fc14b140 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.245+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc067180 con 0x7f48fc14b140 2023-06-09T04:38:58.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.246+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48f4005470 con 0x7f48fc14b140 2023-06-09T04:38:58.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.246+0000 7f48f3fff700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f48dc06ace0 0x7f48dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.246+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f48f40894f0 con 0x7f48fc14b140 2023-06-09T04:38:58.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.246+0000 7f48faffd700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f48dc06ace0 0x7f48dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.247+0000 7f48faffd700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f48dc06ace0 0x7f48dc06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f48e4000c00 tx=0x7f48e4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.250+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f48f4054560 con 0x7f48fc14b140 2023-06-09T04:38:58.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.449+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48fc0cfca0 con 0x7f48fc14b140 2023-06-09T04:38:58.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.450+0000 7f48f3fff700 1 -- 172.21.15.26:0/4193930667 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48f4057b80 con 0x7f48fc14b140 2023-06-09T04:38:58.451 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:38:58.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f48dc06ace0 msgr2=0x7f48dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f48dc06ace0 0x7f48dc06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f48e4000c00 tx=0x7f48e4008030 comp rx=0 tx=0).stop 2023-06-09T04:38:58.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 msgr2=0x7f48fc14b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 0x7f48fc14b5b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b5890 tx=0x7f48f400ee00 comp rx=0 tx=0).stop 2023-06-09T04:38:58.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 shutdown_connections 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f48dc06ace0 0x7f48dc06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48fc14b140 0x7f48fc14b5b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8003a00 0x7f48fc148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 --2- 172.21.15.26:0/4193930667 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f48fc14bdd0 0x7f48fc15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 >> 172.21.15.26:0/4193930667 conn(0x7f48fc098a30 msgr2=0x7f48fc0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 shutdown_connections 2023-06-09T04:38:58.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.452+0000 7f4901994700 1 -- 172.21.15.26:0/4193930667 wait complete. 2023-06-09T04:38:58.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:58.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.590+0000 7f3338f74700 1 Processor -- start 2023-06-09T04:38:58.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.590+0000 7f3338f74700 1 -- start start 2023-06-09T04:38:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3338f74700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33340cdc40 0x7f33341595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3338f74700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33340ca790 con 0x7f33340ca320 2023-06-09T04:38:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3338f74700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33340caa70 con 0x7f33341591d0 2023-06-09T04:38:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3338f74700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3334159ae0 con 0x7f33340cdc40 2023-06-09T04:38:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3332d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33340cdc40 0x7f33341595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3331d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f33340ca320 0x7f33340cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48100/0 (socket says 172.21.15.26:48100) 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.591+0000 7f3331d9b700 1 -- 172.21.15.26:0/2102666399 learned_addr learned my addr 172.21.15.26:0/2102666399 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f3332d9d700 1 -- 172.21.15.26:0/2102666399 >> v1:172.21.15.104:6789/0 conn(0x7f33341591d0 legacy=0x7f33340c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f3332d9d700 1 -- 172.21.15.26:0/2102666399 >> v1:172.21.15.26:6789/0 conn(0x7f33340ca320 legacy=0x7f33340cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f333159a700 1 -- 172.21.15.26:0/2102666399 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538527282 0 0) 0x7f33340ca790 con 0x7f33340ca320 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f3332d9d700 1 -- 172.21.15.26:0/2102666399 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340cad50 con 0x7f33340cdc40 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f3332d9d700 1 --2- 172.21.15.26:0/2102666399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33340cdc40 0x7f33341595a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f332c009d90 tx=0x7f332c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a657aad171c34ce0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f333159a700 1 -- 172.21.15.26:0/2102666399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c00e070 con 0x7f33340cdc40 2023-06-09T04:38:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f333159a700 1 -- 172.21.15.26:0/2102666399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c00bbd0 con 0x7f33340cdc40 2023-06-09T04:38:58.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f333159a700 1 -- 172.21.15.26:0/2102666399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c012430 con 0x7f33340cdc40 2023-06-09T04:38:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f3338f74700 1 -- 172.21.15.26:0/2102666399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33340cdc40 msgr2=0x7f33341595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.592+0000 7f3338f74700 1 --2- 172.21.15.26:0/2102666399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33340cdc40 0x7f33341595a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f332c009d90 tx=0x7f332c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.593+0000 7f3338f74700 1 -- 172.21.15.26:0/2102666399 shutdown_connections 2023-06-09T04:38:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.593+0000 7f3338f74700 1 --2- 172.21.15.26:0/2102666399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33340cdc40 0x7f33341595a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.593+0000 7f3338f74700 1 -- 172.21.15.26:0/2102666399 >> 172.21.15.26:0/2102666399 conn(0x7f33340cb9d0 msgr2=0x7f33340cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.593+0000 7f3338f74700 1 -- 172.21.15.26:0/2102666399 shutdown_connections 2023-06-09T04:38:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.593+0000 7f3338f74700 1 -- 172.21.15.26:0/2102666399 wait complete. 2023-06-09T04:38:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.594+0000 7f3338f74700 1 Processor -- start 2023-06-09T04:38:58.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.594+0000 7f3338f74700 1 -- start start 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3338f74700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33340ca320 0x7f3334156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3338f74700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33340cdc40 0x7f33340b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3338f74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 0x7f33341578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3338f74700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33341f2900 con 0x7f33341591d0 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3338f74700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334157330 con 0x7f33340cdc40 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3338f74700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340b4cb0 con 0x7f33340ca320 2023-06-09T04:38:58.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3332d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 0x7f33341578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.595+0000 7f3332d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 0x7f33341578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39250/0 (socket says 172.21.15.26:39250) 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 -- 172.21.15.26:0/3493777030 learned_addr learned my addr 172.21.15.26:0/3493777030 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3331d9b700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33340cdc40 0x7f33340b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 -- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33340ca320 msgr2=0x7f3334156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f333259c700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33340ca320 0x7f3334156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33340ca320 0x7f3334156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 -- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33340cdc40 msgr2=0x7f33340b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33340cdc40 0x7f33340b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 -- 172.21.15.26:0/3493777030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c009a70 con 0x7f33341591d0 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f333259c700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33340ca320 0x7f3334156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3331d9b700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33340cdc40 0x7f33340b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3332d9d700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 0x7f33341578f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3334071f30 tx=0x7f332c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c01b810 con 0x7f33341591d0 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c020070 con 0x7f33341591d0 2023-06-09T04:38:58.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c01bbb0 con 0x7f33341591d0 2023-06-09T04:38:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33341f1b40 con 0x7f33341591d0 2023-06-09T04:38:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.596+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33341f2100 con 0x7f33341591d0 2023-06-09T04:38:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.597+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3334067180 con 0x7f33341591d0 2023-06-09T04:38:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.598+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f332c01bd10 con 0x7f33341591d0 2023-06-09T04:38:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.598+0000 7f3322ffd700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f331406ace0 0x7f331406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.598+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f332c022070 con 0x7f33341591d0 2023-06-09T04:38:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.598+0000 7f333259c700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f331406ace0 0x7f331406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.599+0000 7f333259c700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f331406ace0 0x7f331406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3328000f60 tx=0x7f3328009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.602+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f332c05a140 con 0x7f33341591d0 2023-06-09T04:38:58.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.817+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33340b4ed0 con 0x7f33341591d0 2023-06-09T04:38:58.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.818+0000 7f3322ffd700 1 -- 172.21.15.26:0/3493777030 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f332c059cd0 con 0x7f33341591d0 2023-06-09T04:38:58.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f331406ace0 msgr2=0x7f331406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f331406ace0 0x7f331406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3328000f60 tx=0x7f3328009040 comp rx=0 tx=0).stop 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 msgr2=0x7f33341578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 0x7f33341578f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3334071f30 tx=0x7f332c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 shutdown_connections 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f331406ace0 0x7f331406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33341591d0 0x7f33341578f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33340ca320 0x7f3334156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 --2- 172.21.15.26:0/3493777030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33340cdc40 0x7f33340b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 >> 172.21.15.26:0/3493777030 conn(0x7f33340cb9d0 msgr2=0x7f3334073080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 shutdown_connections 2023-06-09T04:38:58.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:58.820+0000 7f3338f74700 1 -- 172.21.15.26:0/3493777030 wait complete. 2023-06-09T04:38:58.823 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:38:58.833 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:38:58.833 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:58.851 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:59.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.016+0000 7f6bc038d700 1 Processor -- start 2023-06-09T04:38:59.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.016+0000 7f6bc038d700 1 -- start start 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.016+0000 7f6bc038d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bb8069db0 0x7f6bb80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bc038d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb80ce380 con 0x7f6bb806cea0 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bc038d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb80ce660 con 0x7f6bb80ae920 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bc038d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb80ca670 con 0x7f6bb8069db0 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe129700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bb8069db0 0x7f6bb80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe92a700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6bb806cea0 0x7f6bb806d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48116/0 (socket says 172.21.15.26:48116) 2023-06-09T04:38:59.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe129700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bb8069db0 0x7f6bb80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39254/0 (socket says 172.21.15.26:39254) 2023-06-09T04:38:59.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe92a700 1 -- 172.21.15.26:0/3049643073 learned_addr learned my addr 172.21.15.26:0/3049643073 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe129700 1 -- 172.21.15.26:0/3049643073 >> v1:172.21.15.104:6789/0 conn(0x7f6bb80ae920 legacy=0x7f6bb806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe129700 1 -- 172.21.15.26:0/3049643073 >> v1:172.21.15.26:6789/0 conn(0x7f6bb806cea0 legacy=0x7f6bb806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe129700 1 -- 172.21.15.26:0/3049643073 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80ce940 con 0x7f6bb8069db0 2023-06-09T04:38:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbd127700 1 -- 172.21.15.26:0/3049643073 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209258637 0 0) 0x7f6bb80ce380 con 0x7f6bb806cea0 2023-06-09T04:38:59.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbe129700 1 --2- 172.21.15.26:0/3049643073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb8069db0 0x7f6bb80cdda0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009820 tx=0x7f6bb4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc784f9b8b8663f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbd127700 1 -- 172.21.15.26:0/3049643073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4005e30 con 0x7f6bb8069db0 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbd127700 1 -- 172.21.15.26:0/3049643073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4004030 con 0x7f6bb8069db0 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.017+0000 7f6bbd127700 1 -- 172.21.15.26:0/3049643073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40043c0 con 0x7f6bb8069db0 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 -- 172.21.15.26:0/3049643073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb8069db0 msgr2=0x7f6bb80cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 --2- 172.21.15.26:0/3049643073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb8069db0 0x7f6bb80cdda0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009820 tx=0x7f6bb4009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 -- 172.21.15.26:0/3049643073 shutdown_connections 2023-06-09T04:38:59.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 --2- 172.21.15.26:0/3049643073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb8069db0 0x7f6bb80cdda0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 -- 172.21.15.26:0/3049643073 >> 172.21.15.26:0/3049643073 conn(0x7f6bb8098b50 msgr2=0x7f6bb80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 -- 172.21.15.26:0/3049643073 shutdown_connections 2023-06-09T04:38:59.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.018+0000 7f6bc038d700 1 -- 172.21.15.26:0/3049643073 wait complete. 2023-06-09T04:38:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.019+0000 7f6bc038d700 1 Processor -- start 2023-06-09T04:38:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.019+0000 7f6bc038d700 1 -- start start 2023-06-09T04:38:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bc038d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6bb8069db0 0x7f6bb81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bc038d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb806cea0 0x7f6bb80afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bc038d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 0x7f6bb81f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bc038d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b0410 con 0x7f6bb80ae920 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bc038d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb815d320 con 0x7f6bb806cea0 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bc038d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb815d600 con 0x7f6bb8069db0 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 0x7f6bb81f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 0x7f6bb81f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39264/0 (socket says 172.21.15.26:39264) 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 -- 172.21.15.26:0/521421052 learned_addr learned my addr 172.21.15.26:0/521421052 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbd928700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb806cea0 0x7f6bb80afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe129700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6bb8069db0 0x7f6bb81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 -- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6bb8069db0 msgr2=0x7f6bb81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6bb8069db0 0x7f6bb81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 -- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb806cea0 msgr2=0x7f6bb80afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb806cea0 0x7f6bb80afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.020+0000 7f6bbe92a700 1 -- 172.21.15.26:0/521421052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009430 con 0x7f6bb80ae920 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.021+0000 7f6bbe92a700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 0x7f6bb81f5400 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000cca0 tx=0x7f6bb000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.021+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000cea0 con 0x7f6bb80ae920 2023-06-09T04:38:59.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.021+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000ade0 con 0x7f6bb80ae920 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.021+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80b3460 con 0x7f6bb80ae920 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.021+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0007310 con 0x7f6bb80ae920 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.021+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb80b3a20 con 0x7f6bb80ae920 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.022+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb8067180 con 0x7f6bb80ae920 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.022+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bb0007470 con 0x7f6bb80ae920 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.023+0000 7f6baeffd700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6b9c06ace0 0x7f6b9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.023+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6bb0089520 con 0x7f6bb80ae920 2023-06-09T04:38:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.023+0000 7f6bbe129700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6b9c06ace0 0x7f6b9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.023+0000 7f6bbe129700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6b9c06ace0 0x7f6b9c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4000c00 tx=0x7f6bb4008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.027+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6bb00544f0 con 0x7f6bb80ae920 2023-06-09T04:38:59.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.227+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb80ce0c0 con 0x7f6bb80ae920 2023-06-09T04:38:59.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.228+0000 7f6baeffd700 1 -- 172.21.15.26:0/521421052 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f6bb0057b10 con 0x7f6bb80ae920 2023-06-09T04:38:59.230 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:38:59.230 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:59.131950+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6b9c06ace0 msgr2=0x7f6b9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6b9c06ace0 0x7f6b9c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4000c00 tx=0x7f6bb4008070 comp rx=0 tx=0).stop 2023-06-09T04:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 msgr2=0x7f6bb81f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 0x7f6bb81f5400 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000cca0 tx=0x7f6bb000a340 comp rx=0 tx=0).stop 2023-06-09T04:38:59.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 shutdown_connections 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f6b9c06ace0 0x7f6b9c06d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bb80ae920 0x7f6bb81f5400 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6bb8069db0 0x7f6bb81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 --2- 172.21.15.26:0/521421052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb806cea0 0x7f6bb80afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 >> 172.21.15.26:0/521421052 conn(0x7f6bb8098b50 msgr2=0x7f6bb80cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 shutdown_connections 2023-06-09T04:38:59.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.231+0000 7f6bc038d700 1 -- 172.21.15.26:0/521421052 wait complete. 2023-06-09T04:38:59.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:59.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.372+0000 7fc0e0649700 1 Processor -- start 2023-06-09T04:38:59.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.372+0000 7fc0e0649700 1 -- start start 2023-06-09T04:38:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0e0649700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0d815c6e0 0x7fc0d80ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0e0649700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d80aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0e0649700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d806f190 con 0x7fc0d8098e30 2023-06-09T04:38:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0e0649700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d806e440 con 0x7fc0d815c6e0 2023-06-09T04:38:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0e0649700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d806e690 con 0x7fc0d806e990 2023-06-09T04:38:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0de3e5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc0d815c6e0 0x7fc0d80ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0debe6700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc0d8098e30 0x7fc0d80cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48130/0 (socket says 172.21.15.26:48130) 2023-06-09T04:38:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0debe6700 1 -- 172.21.15.26:0/3989964197 learned_addr learned my addr 172.21.15.26:0/3989964197 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:38:59.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0ddbe4700 1 --2- 172.21.15.26:0/3989964197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d80aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0de3e5700 1 -- 172.21.15.26:0/3989964197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 msgr2=0x7fc0d80aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0de3e5700 1 --2- 172.21.15.26:0/3989964197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d80aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0de3e5700 1 -- 172.21.15.26:0/3989964197 >> v1:172.21.15.26:6789/0 conn(0x7fc0d8098e30 legacy=0x7fc0d80cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0dd3e3700 1 -- 172.21.15.26:0/3989964197 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009975600 0 0) 0x7fc0d806f190 con 0x7fc0d8098e30 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.373+0000 7fc0de3e5700 1 -- 172.21.15.26:0/3989964197 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8160300 con 0x7fc0d815c6e0 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0de3e5700 1 --2- 172.21.15.26:0/3989964197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80ae640 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009820 tx=0x7fc0c8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b97db490f52278 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0dd3e3700 1 -- 172.21.15.26:0/3989964197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8005e30 con 0x7fc0d815c6e0 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0dd3e3700 1 -- 172.21.15.26:0/3989964197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c8006030 con 0x7fc0d815c6e0 2023-06-09T04:38:59.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0dd3e3700 1 -- 172.21.15.26:0/3989964197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c80063c0 con 0x7fc0d815c6e0 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0e0649700 1 -- 172.21.15.26:0/3989964197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 msgr2=0x7fc0d80ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0e0649700 1 --2- 172.21.15.26:0/3989964197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80ae640 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009820 tx=0x7fc0c8009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0e0649700 1 -- 172.21.15.26:0/3989964197 shutdown_connections 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0e0649700 1 --2- 172.21.15.26:0/3989964197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80ae640 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0e0649700 1 --2- 172.21.15.26:0/3989964197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d80aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.374+0000 7fc0e0649700 1 -- 172.21.15.26:0/3989964197 >> 172.21.15.26:0/3989964197 conn(0x7fc0d8098a30 msgr2=0x7fc0d80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.375+0000 7fc0e0649700 1 -- 172.21.15.26:0/3989964197 shutdown_connections 2023-06-09T04:38:59.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.375+0000 7fc0e0649700 1 -- 172.21.15.26:0/3989964197 wait complete. 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 Processor -- start 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 -- start start 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d8153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d8098e30 0x7fc0d80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8153b80 con 0x7fc0d815c6e0 2023-06-09T04:38:59.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80c3310 con 0x7fc0d8098e30 2023-06-09T04:38:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.376+0000 7fc0e0649700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80b3ad0 con 0x7fc0d806e990 2023-06-09T04:38:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39278/0 (socket says 172.21.15.26:39278) 2023-06-09T04:38:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 -- 172.21.15.26:0/760243703 learned_addr learned my addr 172.21.15.26:0/760243703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0ddbe4700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d8098e30 0x7fc0d80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0de3e5700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d8153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 -- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 msgr2=0x7fc0d8153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d8153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 -- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d8098e30 msgr2=0x7fc0d80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d8098e30 0x7fc0d80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 -- 172.21.15.26:0/760243703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c8009430 con 0x7fc0d815c6e0 2023-06-09T04:38:59.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0debe6700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80b06e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000cbd0 tx=0x7fc0d000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000ab70 con 0x7fc0d815c6e0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000acf0 con 0x7fc0d815c6e0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d80c3560 con 0x7fc0d815c6e0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0007310 con 0x7fc0d815c6e0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.377+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d80b3480 con 0x7fc0d815c6e0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.378+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d80ca980 con 0x7fc0d815c6e0 2023-06-09T04:38:59.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.379+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0d0007470 con 0x7fc0d815c6e0 2023-06-09T04:38:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.379+0000 7fc0ceffd700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0bc06ace0 0x7fc0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.379+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc0d0088ff0 con 0x7fc0d815c6e0 2023-06-09T04:38:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.379+0000 7fc0de3e5700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0bc06ace0 0x7fc0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.380+0000 7fc0de3e5700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0bc06ace0 0x7fc0bc06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009b70 tx=0x7fc0c8008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.384+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0d0054060 con 0x7fc0d815c6e0 2023-06-09T04:38:59.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.578+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0d8070f90 con 0x7fc0d815c6e0 2023-06-09T04:38:59.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.579+0000 7fc0ceffd700 1 -- 172.21.15.26:0/760243703 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0d000ae60 con 0x7fc0d815c6e0 2023-06-09T04:38:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:38:59.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0bc06ace0 msgr2=0x7fc0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0bc06ace0 0x7fc0bc06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009b70 tx=0x7fc0c8008070 comp rx=0 tx=0).stop 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 msgr2=0x7fc0d80b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80b06e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000cbd0 tx=0x7fc0d000cf90 comp rx=0 tx=0).stop 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 shutdown_connections 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc0bc06ace0 0x7fc0bc06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0d815c6e0 0x7fc0d80b06e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc0d806e990 0x7fc0d8153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 --2- 172.21.15.26:0/760243703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d8098e30 0x7fc0d80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 >> 172.21.15.26:0/760243703 conn(0x7fc0d8098a30 msgr2=0x7fc0d80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 shutdown_connections 2023-06-09T04:38:59.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.581+0000 7fc0e0649700 1 -- 172.21.15.26:0/760243703 wait complete. 2023-06-09T04:38:59.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:59.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.721+0000 7fa29d91a700 1 Processor -- start 2023-06-09T04:38:59.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.721+0000 7fa29d91a700 1 -- start start 2023-06-09T04:38:59.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa29d91a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa29815d3e0 0x7fa2980d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa29d91a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2980d1300 0x7fa2980b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa29d91a700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29815d950 con 0x7fa2981569b0 2023-06-09T04:38:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa29d91a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2980d0970 con 0x7fa2980d1300 2023-06-09T04:38:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa29d91a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2980cd360 con 0x7fa29815d3e0 2023-06-09T04:38:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2980d1300 0x7fa2980b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2980d1300 0x7fa2980b7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39286/0 (socket says 172.21.15.26:39286) 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 -- 172.21.15.26:0/1227938227 learned_addr learned my addr 172.21.15.26:0/1227938227 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2967fc700 1 --2- 172.21.15.26:0/1227938227 >> v2:172.21.15.104:3300/0 conn(0x7fa29815d3e0 0x7fa2980d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 -- 172.21.15.26:0/1227938227 >> v2:172.21.15.104:3300/0 conn(0x7fa29815d3e0 msgr2=0x7fa2980d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 --2- 172.21.15.26:0/1227938227 >> v2:172.21.15.104:3300/0 conn(0x7fa29815d3e0 0x7fa2980d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 -- 172.21.15.26:0/1227938227 >> v1:172.21.15.104:6789/0 conn(0x7fa2981569b0 legacy=0x7fa2980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 -- 172.21.15.26:0/1227938227 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2980cd640 con 0x7fa2980d1300 2023-06-09T04:38:59.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa2977fe700 1 --2- 172.21.15.26:0/1227938227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2980d1300 0x7fa2980b7a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2980d2ac0 tx=0x7fa29000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa017c0986ea89d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.722+0000 7fa295ffb700 1 -- 172.21.15.26:0/1227938227 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000e070 con 0x7fa2980d1300 2023-06-09T04:38:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa295ffb700 1 -- 172.21.15.26:0/1227938227 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29000b9c0 con 0x7fa2980d1300 2023-06-09T04:38:59.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa295ffb700 1 -- 172.21.15.26:0/1227938227 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000bd70 con 0x7fa2980d1300 2023-06-09T04:38:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 -- 172.21.15.26:0/1227938227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2980d1300 msgr2=0x7fa2980b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 --2- 172.21.15.26:0/1227938227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2980d1300 0x7fa2980b7a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2980d2ac0 tx=0x7fa29000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:59.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 -- 172.21.15.26:0/1227938227 shutdown_connections 2023-06-09T04:38:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 --2- 172.21.15.26:0/1227938227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2980d1300 0x7fa2980b7a50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 --2- 172.21.15.26:0/1227938227 >> v2:172.21.15.104:3300/0 conn(0x7fa29815d3e0 0x7fa2980d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 -- 172.21.15.26:0/1227938227 >> 172.21.15.26:0/1227938227 conn(0x7fa29806b1f0 msgr2=0x7fa29806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 -- 172.21.15.26:0/1227938227 shutdown_connections 2023-06-09T04:38:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.723+0000 7fa29d91a700 1 -- 172.21.15.26:0/1227938227 wait complete. 2023-06-09T04:38:59.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.725+0000 7fa29d91a700 1 Processor -- start 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.725+0000 7fa29d91a700 1 -- start start 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa29d91a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2980d1300 0x7fa29814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa29d91a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 0x7fa2980b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa29d91a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa29815d3e0 0x7fa2981f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa29d91a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980b5a10 con 0x7fa2981569b0 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa29d91a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980c9d50 con 0x7fa2980d1300 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa29d91a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980c8230 con 0x7fa29815d3e0 2023-06-09T04:38:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 0x7fa2980b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 0x7fa2980b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39290/0 (socket says 172.21.15.26:39290) 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 -- 172.21.15.26:0/2296644303 learned_addr learned my addr 172.21.15.26:0/2296644303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa296ffd700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2980d1300 0x7fa29814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2977fe700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa29815d3e0 0x7fa2981f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 -- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa29815d3e0 msgr2=0x7fa2981f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa29815d3e0 0x7fa2981f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 -- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2980d1300 msgr2=0x7fa29814f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2980d1300 0x7fa29814f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 -- 172.21.15.26:0/2296644303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009b30 con 0x7fa2981569b0 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.726+0000 7fa2967fc700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 0x7fa2980b8150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e840 tx=0x7fa28c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.727+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c013610 con 0x7fa2981569b0 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.727+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c013770 con 0x7fa2981569b0 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.727+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2981f61f0 con 0x7fa2981569b0 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.727+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c013b20 con 0x7fa2981569b0 2023-06-09T04:38:59.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.727+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2980c8790 con 0x7fa2981569b0 2023-06-09T04:38:59.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.728+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa298074080 con 0x7fa2981569b0 2023-06-09T04:38:59.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.728+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa28c013c80 con 0x7fa2981569b0 2023-06-09T04:38:59.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.728+0000 7fa27ffff700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa28406ace0 0x7fa28406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.729+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa28c089000 con 0x7fa2981569b0 2023-06-09T04:38:59.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.729+0000 7fa296ffd700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa28406ace0 0x7fa28406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.729+0000 7fa296ffd700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa28406ace0 0x7fa28406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa288000fb0 tx=0x7fa288009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.733+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa28c057b10 con 0x7fa2981569b0 2023-06-09T04:38:59.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.933+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2980ccf10 con 0x7fa2981569b0 2023-06-09T04:38:59.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.933+0000 7fa27ffff700 1 -- 172.21.15.26:0/2296644303 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa28c0576a0 con 0x7fa2981569b0 2023-06-09T04:38:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:38:59.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa28406ace0 msgr2=0x7fa28406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa28406ace0 0x7fa28406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa288000fb0 tx=0x7fa288009040 comp rx=0 tx=0).stop 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 msgr2=0x7fa2980b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 0x7fa2980b8150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e840 tx=0x7fa28c00eb50 comp rx=0 tx=0).stop 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 shutdown_connections 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa29815d3e0 0x7fa2981f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2980d1300 0x7fa29814f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa28406ace0 0x7fa28406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 --2- 172.21.15.26:0/2296644303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2981569b0 0x7fa2980b8150 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 >> 172.21.15.26:0/2296644303 conn(0x7fa29806b1f0 msgr2=0x7fa29815f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 shutdown_connections 2023-06-09T04:38:59.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:38:59.935+0000 7fa29d91a700 1 -- 172.21.15.26:0/2296644303 wait complete. 2023-06-09T04:38:59.948 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.074+0000 7ff54cc16700 1 Processor -- start 2023-06-09T04:39:00.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.074+0000 7ff54cc16700 1 -- start start 2023-06-09T04:39:00.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff54cc16700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff54815f930 0x7ff5480cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff54cc16700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5480cfc80 0x7ff5480d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff54cc16700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480d08f0 con 0x7ff5480d3370 2023-06-09T04:39:00.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff54cc16700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480b23d0 con 0x7ff54815f930 2023-06-09T04:39:00.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff54cc16700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480d37e0 con 0x7ff5480cfc80 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff54659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff54815f930 0x7ff5480cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff545d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff5480d3370 0x7ff5480cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48156/0 (socket says 172.21.15.26:48156) 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff545d9b700 1 -- 172.21.15.26:0/4147347926 learned_addr learned my addr 172.21.15.26:0/4147347926 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.075+0000 7ff546d9d700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5480cfc80 0x7ff5480d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54659c700 1 -- 172.21.15.26:0/4147347926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5480cfc80 msgr2=0x7ff5480d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54659c700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5480cfc80 0x7ff5480d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54659c700 1 -- 172.21.15.26:0/4147347926 >> v1:172.21.15.26:6789/0 conn(0x7ff5480d3370 legacy=0x7ff5480cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54559a700 1 -- 172.21.15.26:0/4147347926 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918239375 0 0) 0x7ff5480d08f0 con 0x7ff5480d3370 2023-06-09T04:39:00.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54659c700 1 -- 172.21.15.26:0/4147347926 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480cd330 con 0x7ff54815f930 2023-06-09T04:39:00.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff546d9d700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5480cfc80 0x7ff5480d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54659c700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54815f930 0x7ff5480cee20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009840 tx=0x7ff53c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7534c49a61dda4a1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54559a700 1 -- 172.21.15.26:0/4147347926 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c011830 con 0x7ff54815f930 2023-06-09T04:39:00.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54559a700 1 -- 172.21.15.26:0/4147347926 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c011990 con 0x7ff54815f930 2023-06-09T04:39:00.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54559a700 1 -- 172.21.15.26:0/4147347926 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c011d20 con 0x7ff54815f930 2023-06-09T04:39:00.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54cc16700 1 -- 172.21.15.26:0/4147347926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54815f930 msgr2=0x7ff5480cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.076+0000 7ff54cc16700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54815f930 0x7ff5480cee20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009840 tx=0x7ff53c009b50 comp rx=0 tx=0).stop 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.077+0000 7ff54cc16700 1 -- 172.21.15.26:0/4147347926 shutdown_connections 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.077+0000 7ff54cc16700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5480cfc80 0x7ff5480d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.077+0000 7ff54cc16700 1 --2- 172.21.15.26:0/4147347926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54815f930 0x7ff5480cee20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.077+0000 7ff54cc16700 1 -- 172.21.15.26:0/4147347926 >> 172.21.15.26:0/4147347926 conn(0x7ff54806b270 msgr2=0x7ff54806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.077+0000 7ff54cc16700 1 -- 172.21.15.26:0/4147347926 shutdown_connections 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.077+0000 7ff54cc16700 1 -- 172.21.15.26:0/4147347926 wait complete. 2023-06-09T04:39:00.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.078+0000 7ff54cc16700 1 Processor -- start 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.078+0000 7ff54cc16700 1 -- start start 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5480cfc80 0x7ff548156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 0x7ff5480c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff54815f930 0x7ff54815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cad40 con 0x7ff5480d3370 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480ca0c0 con 0x7ff5480cfc80 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480ca3a0 con 0x7ff54815f930 2023-06-09T04:39:00.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 0x7ff5480c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 0x7ff5480c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39304/0 (socket says 172.21.15.26:39304) 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 -- 172.21.15.26:0/1841921507 learned_addr learned my addr 172.21.15.26:0/1841921507 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff546d9d700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff54815f930 0x7ff54815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54659c700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5480cfc80 0x7ff548156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 -- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff54815f930 msgr2=0x7ff54815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff54815f930 0x7ff54815a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 -- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5480cfc80 msgr2=0x7ff548156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5480cfc80 0x7ff548156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 -- 172.21.15.26:0/1841921507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0094a0 con 0x7ff5480d3370 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff546d9d700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff54815f930 0x7ff54815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff545d9b700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 0x7ff5480c70f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5380011e0 tx=0x7ff53800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538004c80 con 0x7ff5480d3370 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5480ca680 con 0x7ff5480d3370 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538004e00 con 0x7ff5480d3370 2023-06-09T04:39:00.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.079+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538007310 con 0x7ff5480d3370 2023-06-09T04:39:00.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.080+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff548156b50 con 0x7ff5480d3370 2023-06-09T04:39:00.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.080+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff548067180 con 0x7ff5480d3370 2023-06-09T04:39:00.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.081+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff538007470 con 0x7ff5480d3370 2023-06-09T04:39:00.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.081+0000 7ff536ffd700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff52806ace0 0x7ff52806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.082+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff538089230 con 0x7ff5480d3370 2023-06-09T04:39:00.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.082+0000 7ff54659c700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff52806ace0 0x7ff52806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.082+0000 7ff54659c700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff52806ace0 0x7ff52806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0090b0 tx=0x7ff53c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.086+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff5380542b0 con 0x7ff5480d3370 2023-06-09T04:39:00.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.284+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5480b4fc0 con 0x7ff5480d3370 2023-06-09T04:39:00.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.284+0000 7ff536ffd700 1 -- 172.21.15.26:0/1841921507 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5380578d0 con 0x7ff5480d3370 2023-06-09T04:39:00.286 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:39:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff52806ace0 msgr2=0x7ff52806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff52806ace0 0x7ff52806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0090b0 tx=0x7ff53c008030 comp rx=0 tx=0).stop 2023-06-09T04:39:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 msgr2=0x7ff5480c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 0x7ff5480c70f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5380011e0 tx=0x7ff53800cae0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 shutdown_connections 2023-06-09T04:39:00.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff54815f930 0x7ff54815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5480cfc80 0x7ff548156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff52806ace0 0x7ff52806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.286+0000 7ff54cc16700 1 --2- 172.21.15.26:0/1841921507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5480d3370 0x7ff5480c70f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.287+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 >> 172.21.15.26:0/1841921507 conn(0x7ff54806b270 msgr2=0x7ff5480b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.287+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 shutdown_connections 2023-06-09T04:39:00.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.287+0000 7ff54cc16700 1 -- 172.21.15.26:0/1841921507 wait complete. 2023-06-09T04:39:00.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:00.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.426+0000 7f58985e7700 1 Processor -- start 2023-06-09T04:39:00.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.426+0000 7f58985e7700 1 -- start start 2023-06-09T04:39:00.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f58985e7700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f589015c6e0 0x7f58900ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f58985e7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f589006e990 0x7f58900aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f58985e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589006f190 con 0x7f5890098e30 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f58985e7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589006e440 con 0x7f589006e990 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f58985e7700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589006e690 con 0x7f589015c6e0 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895b82700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f589006e990 0x7f58900aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5896b84700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5890098e30 0x7f58900cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48168/0 (socket says 172.21.15.26:48168) 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5896b84700 1 -- 172.21.15.26:0/1835310401 learned_addr learned my addr 172.21.15.26:0/1835310401 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:00.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5896383700 1 --2- 172.21.15.26:0/1835310401 >> v2:172.21.15.104:3300/0 conn(0x7f589015c6e0 0x7f58900ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895b82700 1 -- 172.21.15.26:0/1835310401 >> v2:172.21.15.104:3300/0 conn(0x7f589015c6e0 msgr2=0x7f58900ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895b82700 1 --2- 172.21.15.26:0/1835310401 >> v2:172.21.15.104:3300/0 conn(0x7f589015c6e0 0x7f58900ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895b82700 1 -- 172.21.15.26:0/1835310401 >> v1:172.21.15.26:6789/0 conn(0x7f5890098e30 legacy=0x7f58900cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895b82700 1 -- 172.21.15.26:0/1835310401 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890160300 con 0x7f589006e990 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895381700 1 -- 172.21.15.26:0/1835310401 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302847300 0 0) 0x7f589006f190 con 0x7f5890098e30 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895b82700 1 --2- 172.21.15.26:0/1835310401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589006e990 0x7f58900aeb80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f58900b23a0 tx=0x7f5880009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511ef2dc493a630c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.427+0000 7f5895381700 1 -- 172.21.15.26:0/1835310401 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880011830 con 0x7f589006e990 2023-06-09T04:39:00.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f5895381700 1 -- 172.21.15.26:0/1835310401 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5880011990 con 0x7f589006e990 2023-06-09T04:39:00.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f5895381700 1 -- 172.21.15.26:0/1835310401 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880011d20 con 0x7f589006e990 2023-06-09T04:39:00.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 -- 172.21.15.26:0/1835310401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589006e990 msgr2=0x7f58900aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 --2- 172.21.15.26:0/1835310401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589006e990 0x7f58900aeb80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f58900b23a0 tx=0x7f5880009b20 comp rx=0 tx=0).stop 2023-06-09T04:39:00.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 -- 172.21.15.26:0/1835310401 shutdown_connections 2023-06-09T04:39:00.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 --2- 172.21.15.26:0/1835310401 >> v2:172.21.15.104:3300/0 conn(0x7f589015c6e0 0x7f58900ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 --2- 172.21.15.26:0/1835310401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589006e990 0x7f58900aeb80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 -- 172.21.15.26:0/1835310401 >> 172.21.15.26:0/1835310401 conn(0x7f5890098a30 msgr2=0x7f58900cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 -- 172.21.15.26:0/1835310401 shutdown_connections 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.428+0000 7f58985e7700 1 -- 172.21.15.26:0/1835310401 wait complete. 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.429+0000 7f58985e7700 1 Processor -- start 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.429+0000 7f58985e7700 1 -- start start 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f58985e7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f589006e990 0x7f5890153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f58985e7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5890098e30 0x7f58900b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f58985e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 0x7f58900b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f58985e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c4c10 con 0x7f589015c6e0 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f58985e7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c3d20 con 0x7f5890098e30 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f58985e7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c4000 con 0x7f589006e990 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f5896b84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 0x7f58900b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f5896b84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 0x7f58900b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39320/0 (socket says 172.21.15.26:39320) 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f5896b84700 1 -- 172.21.15.26:0/257473233 learned_addr learned my addr 172.21.15.26:0/257473233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:00.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f5895b82700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5890098e30 0x7f58900b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.430+0000 7f5896383700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f589006e990 0x7f5890153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896b84700 1 -- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f589006e990 msgr2=0x7f5890153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896b84700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f589006e990 0x7f5890153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896b84700 1 -- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5890098e30 msgr2=0x7f58900b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896b84700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5890098e30 0x7f58900b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896b84700 1 -- 172.21.15.26:0/257473233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800094a0 con 0x7f589015c6e0 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896383700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f589006e990 0x7f5890153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:00.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5896b84700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 0x7f58900b0910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f588800cba0 tx=0x7f588800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800aad0 con 0x7f589015c6e0 2023-06-09T04:39:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588800ac50 con 0x7f589015c6e0 2023-06-09T04:39:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58900c42e0 con 0x7f589015c6e0 2023-06-09T04:39:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880070d0 con 0x7f589015c6e0 2023-06-09T04:39:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.431+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58900c48a0 con 0x7f589015c6e0 2023-06-09T04:39:00.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.432+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58900b2610 con 0x7f589015c6e0 2023-06-09T04:39:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.432+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5888007230 con 0x7f589015c6e0 2023-06-09T04:39:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.433+0000 7f5886ffd700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f587406ace0 0x7f587406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.433+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f58880892a0 con 0x7f589015c6e0 2023-06-09T04:39:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.433+0000 7f5896383700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f587406ace0 0x7f587406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.434+0000 7f5896383700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f587406ace0 0x7f587406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.437+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58900b2610 con 0x7f589015c6e0 2023-06-09T04:39:00.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.634+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58900b2610 con 0x7f589015c6e0 2023-06-09T04:39:00.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.634+0000 7f5886ffd700 1 -- 172.21.15.26:0/257473233 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58900b2610 con 0x7f589015c6e0 2023-06-09T04:39:00.636 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:39:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.636+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f587406ace0 msgr2=0x7f587406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.636+0000 7f58985e7700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f587406ace0 0x7f587406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.636+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 msgr2=0x7f58900b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.636+0000 7f58985e7700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 0x7f58900b0910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f588800cba0 tx=0x7f588800ceb0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 shutdown_connections 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f587406ace0 0x7f587406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f589015c6e0 0x7f58900b0910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f589006e990 0x7f5890153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 --2- 172.21.15.26:0/257473233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5890098e30 0x7f58900b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 >> 172.21.15.26:0/257473233 conn(0x7f5890098a30 msgr2=0x7f58900adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 shutdown_connections 2023-06-09T04:39:00.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.637+0000 7f58985e7700 1 -- 172.21.15.26:0/257473233 wait complete. 2023-06-09T04:39:00.650 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.774+0000 7f5e8f9ce700 1 Processor -- start 2023-06-09T04:39:00.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.774+0000 7f5e8f9ce700 1 -- start start 2023-06-09T04:39:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8f9ce700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e8815d780 0x7f5e880b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8f9ce700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5e880b07c0 0x7f5e880cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8f9ce700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e880cc0f0 con 0x7f5e880caf70 2023-06-09T04:39:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8f9ce700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e880b00a0 con 0x7f5e8815d780 2023-06-09T04:39:00.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8f9ce700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e880cfc20 con 0x7f5e880b07c0 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8d76a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5e8815d780 0x7f5e880b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8df6b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e880caf70 0x7f5e880ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48186/0 (socket says 172.21.15.26:48186) 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8df6b700 1 -- 172.21.15.26:0/195503320 learned_addr learned my addr 172.21.15.26:0/195503320 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8cf69700 1 --2- 172.21.15.26:0/195503320 >> v2:172.21.15.104:3300/0 conn(0x7f5e880b07c0 0x7f5e880cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8d76a700 1 -- 172.21.15.26:0/195503320 >> v2:172.21.15.104:3300/0 conn(0x7f5e880b07c0 msgr2=0x7f5e880cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8d76a700 1 --2- 172.21.15.26:0/195503320 >> v2:172.21.15.104:3300/0 conn(0x7f5e880b07c0 0x7f5e880cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8d76a700 1 -- 172.21.15.26:0/195503320 >> v1:172.21.15.26:6789/0 conn(0x7f5e880caf70 legacy=0x7f5e880ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e8d76a700 1 -- 172.21.15.26:0/195503320 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880cb4e0 con 0x7f5e8815d780 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.775+0000 7f5e7ffff700 1 -- 172.21.15.26:0/195503320 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569748205 0 0) 0x7f5e880cc0f0 con 0x7f5e880caf70 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8cf69700 1 --2- 172.21.15.26:0/195503320 >> v2:172.21.15.104:3300/0 conn(0x7f5e880b07c0 0x7f5e880cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8d76a700 1 --2- 172.21.15.26:0/195503320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e8815d780 0x7f5e880b0280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e880d01f0 tx=0x7f5e78009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30e363767df15e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e7ffff700 1 -- 172.21.15.26:0/195503320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78005e30 con 0x7f5e8815d780 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e7ffff700 1 -- 172.21.15.26:0/195503320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78006030 con 0x7f5e8815d780 2023-06-09T04:39:00.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e7ffff700 1 -- 172.21.15.26:0/195503320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780063c0 con 0x7f5e8815d780 2023-06-09T04:39:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/195503320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e8815d780 msgr2=0x7f5e880b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/195503320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e8815d780 0x7f5e880b0280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e880d01f0 tx=0x7f5e78009b00 comp rx=0 tx=0).stop 2023-06-09T04:39:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/195503320 shutdown_connections 2023-06-09T04:39:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/195503320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e8815d780 0x7f5e880b0280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/195503320 >> v2:172.21.15.104:3300/0 conn(0x7f5e880b07c0 0x7f5e880cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.776+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/195503320 >> 172.21.15.26:0/195503320 conn(0x7f5e88089fc0 msgr2=0x7f5e880d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.777+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/195503320 shutdown_connections 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.777+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/195503320 wait complete. 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.778+0000 7f5e8f9ce700 1 Processor -- start 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.778+0000 7f5e8f9ce700 1 -- start start 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e880b07c0 0x7f5e8815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 0x7f5e880c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8815d780 0x7f5e880c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880b4b60 con 0x7f5e880caf70 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880b4e40 con 0x7f5e8815d780 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880b5120 con 0x7f5e880b07c0 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 0x7f5e880c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 0x7f5e880c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39332/0 (socket says 172.21.15.26:39332) 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 -- 172.21.15.26:0/2788187091 learned_addr learned my addr 172.21.15.26:0/2788187091 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8df6b700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8815d780 0x7f5e880c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8d76a700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e880b07c0 0x7f5e8815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 -- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e880b07c0 msgr2=0x7f5e8815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e880b07c0 0x7f5e8815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 -- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8815d780 msgr2=0x7f5e880c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8815d780 0x7f5e880c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 -- 172.21.15.26:0/2788187091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78009430 con 0x7f5e880caf70 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8d76a700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e880b07c0 0x7f5e8815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8cf69700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 0x7f5e880c52d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400c7f0 tx=0x7f5e8400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84011800 con 0x7f5e880caf70 2023-06-09T04:39:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e84011960 con 0x7f5e880caf70 2023-06-09T04:39:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84011d10 con 0x7f5e880caf70 2023-06-09T04:39:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.779+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e880b5400 con 0x7f5e880caf70 2023-06-09T04:39:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.780+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e880b4870 con 0x7f5e880caf70 2023-06-09T04:39:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.781+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e880b5920 con 0x7f5e880caf70 2023-06-09T04:39:00.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.781+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e84018360 con 0x7f5e880caf70 2023-06-09T04:39:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.781+0000 7f5e7dffb700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e6c06acb0 0x7f5e6c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.781+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5e840894a0 con 0x7f5e880caf70 2023-06-09T04:39:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.781+0000 7f5e8d76a700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e6c06acb0 0x7f5e6c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.782+0000 7f5e8d76a700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e6c06acb0 0x7f5e6c06d160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e78013040 tx=0x7f5e78008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.785+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e880b5920 con 0x7f5e880caf70 2023-06-09T04:39:00.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.997+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e880b5920 con 0x7f5e880caf70 2023-06-09T04:39:00.998 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:00.997+0000 7f5e7dffb700 1 -- 172.21.15.26:0/2788187091 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e880b5920 con 0x7f5e880caf70 2023-06-09T04:39:01.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e6c06acb0 msgr2=0x7f5e6c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e6c06acb0 0x7f5e6c06d160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e78013040 tx=0x7f5e78008070 comp rx=0 tx=0).stop 2023-06-09T04:39:01.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 msgr2=0x7f5e880c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.001 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 0x7f5e880c52d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400c7f0 tx=0x7f5e8400cbb0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 shutdown_connections 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8815d780 0x7f5e880c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e880b07c0 0x7f5e8815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e6c06acb0 0x7f5e6c06d160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 --2- 172.21.15.26:0/2788187091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e880caf70 0x7f5e880c52d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 >> 172.21.15.26:0/2788187091 conn(0x7f5e88089fc0 msgr2=0x7f5e880d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 shutdown_connections 2023-06-09T04:39:01.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.000+0000 7f5e8f9ce700 1 -- 172.21.15.26:0/2788187091 wait complete. 2023-06-09T04:39:01.003 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:39:01.013 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2023-06-09T04:39:01.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:01.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-06-09T04:39:01.056 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:01.056 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-06-09T04:39:01.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:01.057 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T04:39:01.112 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:39:01.113 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:01.133 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:39:01.134 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:01.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:01.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.316+0000 7f9fb05dc700 1 Processor -- start 2023-06-09T04:39:01.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.316+0000 7f9fb05dc700 1 -- start start 2023-06-09T04:39:01.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fb05dc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 0x7f9fa80cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fb05dc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 0x7f9fa80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fb05dc700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80cf350 con 0x7f9fa80d0070 2023-06-09T04:39:01.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fb05dc700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80cd1d0 con 0x7f9fa80b5930 2023-06-09T04:39:01.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fb05dc700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80cd4b0 con 0x7f9fa815c440 2023-06-09T04:39:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fadb77700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 0x7f9fa80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fae378700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 0x7f9fa80cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fadb77700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 0x7f9fa80b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:46460/0 (socket says 172.21.15.26:46460) 2023-06-09T04:39:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fae378700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 0x7f9fa80cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:49996/0 (socket says 172.21.15.26:49996) 2023-06-09T04:39:01.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fadb77700 1 -- 172.21.15.26:0/95571955 learned_addr learned my addr 172.21.15.26:0/95571955 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:01.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fae378700 1 -- 172.21.15.26:0/95571955 >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 msgr2=0x7f9fa80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fae378700 1 --2- 172.21.15.26:0/95571955 >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 0x7f9fa80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fae378700 1 -- 172.21.15.26:0/95571955 >> v1:172.21.15.104:6789/0 conn(0x7f9fa80d0070 legacy=0x7f9fa806b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fad376700 1 -- 172.21.15.26:0/95571955 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229775973 0 0) 0x7f9fa80cf350 con 0x7f9fa80d0070 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fae378700 1 -- 172.21.15.26:0/95571955 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80cd790 con 0x7f9fa815c440 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.317+0000 7f9fadb77700 1 --2- 172.21.15.26:0/95571955 >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 0x7f9fa80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fae378700 1 --2- 172.21.15.26:0/95571955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 0x7f9fa80cee10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009840 tx=0x7f9fa4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e81f731534aa1a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fad376700 1 -- 172.21.15.26:0/95571955 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4011830 con 0x7f9fa815c440 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fad376700 1 -- 172.21.15.26:0/95571955 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4011990 con 0x7f9fa815c440 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fad376700 1 -- 172.21.15.26:0/95571955 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4011d20 con 0x7f9fa815c440 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 -- 172.21.15.26:0/95571955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 msgr2=0x7f9fa80cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/95571955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 0x7f9fa80cee10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009840 tx=0x7f9fa4009b50 comp rx=0 tx=0).stop 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 -- 172.21.15.26:0/95571955 shutdown_connections 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/95571955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa815c440 0x7f9fa80cee10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/95571955 >> v2:172.21.15.104:3300/0 conn(0x7f9fa80b5930 0x7f9fa80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 -- 172.21.15.26:0/95571955 >> 172.21.15.26:0/95571955 conn(0x7f9fa80cf560 msgr2=0x7f9fa80cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 -- 172.21.15.26:0/95571955 shutdown_connections 2023-06-09T04:39:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.318+0000 7f9fb05dc700 1 -- 172.21.15.26:0/95571955 wait complete. 2023-06-09T04:39:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 Processor -- start 2023-06-09T04:39:01.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 -- start start 2023-06-09T04:39:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa80b5930 0x7f9fa8147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 0x7f9fa815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fa815c440 0x7f9fa80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815a110 con 0x7f9fa80d0070 2023-06-09T04:39:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815a3f0 con 0x7f9fa815c440 2023-06-09T04:39:01.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.320+0000 7f9fb05dc700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815a6d0 con 0x7f9fa80b5930 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 0x7f9fa815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 0x7f9fa815c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39346/0 (socket says 172.21.15.26:39346) 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 -- 172.21.15.26:0/155816273 learned_addr learned my addr 172.21.15.26:0/155816273 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fae378700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa80b5930 0x7f9fa8147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9faeb79700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fa815c440 0x7f9fa80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 -- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa80b5930 msgr2=0x7f9fa8147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa80b5930 0x7f9fa8147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 -- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fa815c440 msgr2=0x7f9fa80c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fa815c440 0x7f9fa80c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 -- 172.21.15.26:0/155816273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98009550 con 0x7f9fa80d0070 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fadb77700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 0x7f9fa815c990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800ebe0 tx=0x7f9f9800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800c850 con 0x7f9fa80d0070 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800c9b0 con 0x7f9fa80d0070 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa40094a0 con 0x7f9fa80d0070 2023-06-09T04:39:01.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800cd40 con 0x7f9fa80d0070 2023-06-09T04:39:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.321+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa815ac90 con 0x7f9fa80d0070 2023-06-09T04:39:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.322+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa815b000 con 0x7f9fa80d0070 2023-06-09T04:39:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.323+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f98013470 con 0x7f9fa80d0070 2023-06-09T04:39:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.323+0000 7f9f9effd700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f8c06ace0 0x7f9f8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.323+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9f98089550 con 0x7f9fa80d0070 2023-06-09T04:39:01.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.324+0000 7f9fae378700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f8c06ace0 0x7f9f8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.324+0000 7f9fae378700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f8c06ace0 0x7f9f8c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40090b0 tx=0x7f9fa4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.328+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f98054650 con 0x7f9fa80d0070 2023-06-09T04:39:01.525 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.524+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fa806bee0 con 0x7f9fa80d0070 2023-06-09T04:39:01.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.525+0000 7f9f9effd700 1 -- 172.21.15.26:0/155816273 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f9f98057c70 con 0x7f9fa80d0070 2023-06-09T04:39:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:01.527 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:59.131950+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:01.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f8c06ace0 msgr2=0x7f9f8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f8c06ace0 0x7f9f8c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40090b0 tx=0x7f9fa4008030 comp rx=0 tx=0).stop 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 msgr2=0x7f9fa815c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 0x7f9fa815c990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800ebe0 tx=0x7f9f9800eef0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 shutdown_connections 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fa815c440 0x7f9fa80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9fa80b5930 0x7f9fa8147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f9f8c06ace0 0x7f9f8c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 --2- 172.21.15.26:0/155816273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fa80d0070 0x7f9fa815c990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 >> 172.21.15.26:0/155816273 conn(0x7f9fa80cf560 msgr2=0x7f9fa80b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 shutdown_connections 2023-06-09T04:39:01.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.527+0000 7f9fb05dc700 1 -- 172.21.15.26:0/155816273 wait complete. 2023-06-09T04:39:01.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:39:01.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:01.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.667+0000 7f129ba0c700 1 Processor -- start 2023-06-09T04:39:01.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.667+0000 7f129ba0c700 1 -- start start 2023-06-09T04:39:01.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f129ba0c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f129415a310 0x7f12940cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f129ba0c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940ac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f129ba0c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940cd880 con 0x7f1294098ea0 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f129ba0c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940ce280 con 0x7f129415a310 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f129ba0c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940cdb60 con 0x7f129415a6e0 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f12997a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f129415a310 0x7f12940cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f1299fa9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1294098ea0 0x7f1294069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48214/0 (socket says 172.21.15.26:48214) 2023-06-09T04:39:01.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f12997a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f129415a310 0x7f12940cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39352/0 (socket says 172.21.15.26:39352) 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f1299fa9700 1 -- 172.21.15.26:0/2129060133 learned_addr learned my addr 172.21.15.26:0/2129060133 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.668+0000 7f1298fa7700 1 --2- 172.21.15.26:0/2129060133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f12997a8700 1 -- 172.21.15.26:0/2129060133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 msgr2=0x7f12940ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f12997a8700 1 --2- 172.21.15.26:0/2129060133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f12997a8700 1 -- 172.21.15.26:0/2129060133 >> v1:172.21.15.26:6789/0 conn(0x7f1294098ea0 legacy=0x7f1294069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f12997a8700 1 -- 172.21.15.26:0/2129060133 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129406e190 con 0x7f129415a310 2023-06-09T04:39:01.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f128bfff700 1 -- 172.21.15.26:0/2129060133 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948244633 0 0) 0x7f12940cd880 con 0x7f1294098ea0 2023-06-09T04:39:01.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f12997a8700 1 --2- 172.21.15.26:0/2129060133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940cede0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1284009820 tx=0x7f1284009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d3b47a5c8ff0a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f128bfff700 1 -- 172.21.15.26:0/2129060133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284005e30 con 0x7f129415a310 2023-06-09T04:39:01.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f128bfff700 1 -- 172.21.15.26:0/2129060133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1284006030 con 0x7f129415a310 2023-06-09T04:39:01.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f128bfff700 1 -- 172.21.15.26:0/2129060133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840063e0 con 0x7f129415a310 2023-06-09T04:39:01.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f129ba0c700 1 -- 172.21.15.26:0/2129060133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 msgr2=0x7f12940cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f129ba0c700 1 --2- 172.21.15.26:0/2129060133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940cede0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1284009820 tx=0x7f1284009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:01.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f129ba0c700 1 -- 172.21.15.26:0/2129060133 shutdown_connections 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f129ba0c700 1 --2- 172.21.15.26:0/2129060133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940cede0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f129ba0c700 1 --2- 172.21.15.26:0/2129060133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.669+0000 7f129ba0c700 1 -- 172.21.15.26:0/2129060133 >> 172.21.15.26:0/2129060133 conn(0x7f1294098a30 msgr2=0x7f12940cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.670+0000 7f129ba0c700 1 -- 172.21.15.26:0/2129060133 shutdown_connections 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.670+0000 7f129ba0c700 1 -- 172.21.15.26:0/2129060133 wait complete. 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 Processor -- start 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 -- start start 2023-06-09T04:39:01.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1294098ea0 0x7f1294159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294159b90 con 0x7f129415a310 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c6070 con 0x7f1294098ea0 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.671+0000 7f129ba0c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294153110 con 0x7f129415a6e0 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39360/0 (socket says 172.21.15.26:39360) 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 -- 172.21.15.26:0/455292461 learned_addr learned my addr 172.21.15.26:0/455292461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f12997a8700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1294098ea0 0x7f1294159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1299fa9700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 -- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 msgr2=0x7f12940c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 -- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1294098ea0 msgr2=0x7f1294159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1294098ea0 0x7f1294159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 -- 172.21.15.26:0/455292461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284009430 con 0x7f129415a310 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1299fa9700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1298fa7700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940c55f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f129000e810 tx=0x7f129000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290013610 con 0x7f129415a310 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290013770 con 0x7f129415a310 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12941533f0 con 0x7f129415a310 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.672+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290013b20 con 0x7f129415a310 2023-06-09T04:39:01.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.673+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941539b0 con 0x7f129415a310 2023-06-09T04:39:01.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.673+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294067180 con 0x7f129415a310 2023-06-09T04:39:01.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.674+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1290013c80 con 0x7f129415a310 2023-06-09T04:39:01.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.674+0000 7f1289ffb700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f127806ace0 0x7f127806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.674+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f12900891a0 con 0x7f129415a310 2023-06-09T04:39:01.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.675+0000 7f12997a8700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f127806ace0 0x7f127806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.675+0000 7f12997a8700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f127806ace0 0x7f127806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1284013040 tx=0x7f1284008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.679+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1290057c10 con 0x7f129415a310 2023-06-09T04:39:01.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.876+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1294158330 con 0x7f129415a310 2023-06-09T04:39:01.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.876+0000 7f1289ffb700 1 -- 172.21.15.26:0/455292461 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12900577a0 con 0x7f129415a310 2023-06-09T04:39:01.877 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:39:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f127806ace0 msgr2=0x7f127806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f127806ace0 0x7f127806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1284013040 tx=0x7f1284008070 comp rx=0 tx=0).stop 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 msgr2=0x7f12940c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940c55f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f129000e810 tx=0x7f129000eb20 comp rx=0 tx=0).stop 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 shutdown_connections 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f129415a6e0 0x7f12940c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1294098ea0 0x7f1294159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f127806ace0 0x7f127806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 --2- 172.21.15.26:0/455292461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f129415a310 0x7f12940c55f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 >> 172.21.15.26:0/455292461 conn(0x7f1294098a30 msgr2=0x7f12940b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 shutdown_connections 2023-06-09T04:39:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:01.878+0000 7f129ba0c700 1 -- 172.21.15.26:0/455292461 wait complete. 2023-06-09T04:39:01.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.017+0000 7f0510c50700 1 Processor -- start 2023-06-09T04:39:02.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.017+0000 7f0510c50700 1 -- start start 2023-06-09T04:39:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0510c50700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c1591d0 0x7f050c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0510c50700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f050c0cdc40 0x7f050c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0510c50700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0ca790 con 0x7f050c0c9c10 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0510c50700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c159ae0 con 0x7f050c0cdc40 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0510c50700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0caa70 con 0x7f050c1591d0 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0509d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f050c0c9c10 0x7f050c0cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48224/0 (socket says 172.21.15.26:48224) 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f0509d9b700 1 -- 172.21.15.26:0/449914630 learned_addr learned my addr 172.21.15.26:0/449914630 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f050a59c700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c1591d0 0x7f050c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f050ad9d700 1 --2- 172.21.15.26:0/449914630 >> v2:172.21.15.104:3300/0 conn(0x7f050c0cdc40 0x7f050c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457530034 0 0) 0x7f050c0ca790 con 0x7f050c0c9c10 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.018+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f40035b0 con 0x7f050c0c9c10 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287176357 0 0) 0x7f04f40035b0 con 0x7f050c0c9c10 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c1591d0 msgr2=0x7f050c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c1591d0 0x7f050c1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 >> v2:172.21.15.104:3300/0 conn(0x7f050c0cdc40 msgr2=0x7f050c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 --2- 172.21.15.26:0/449914630 >> v2:172.21.15.104:3300/0 conn(0x7f050c0cdc40 0x7f050c0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0cad50 con 0x7f050c0c9c10 2023-06-09T04:39:02.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f04fc001670 con 0x7f050c0c9c10 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 >> v1:172.21.15.26:6789/0 conn(0x7f050c0c9c10 legacy=0x7f050c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04f4004430 0x7f04f40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f04f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0caa70 con 0x7f04f4004fb0 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400bf50 con 0x7f04f4003a00 2023-06-09T04:39:02.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400c090 con 0x7f04f4004430 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 --2- 172.21.15.26:0/449914630 >> v2:172.21.15.104:3300/0 conn(0x7f050c0cdc40 0x7f050c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050a59c700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c1591d0 0x7f050c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f04f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f0509d9b700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04f4004430 0x7f04f40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050a59c700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 -- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04f4004430 msgr2=0x7f04f40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04f4004430 0x7f04f40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 -- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f4003a00 msgr2=0x7f04f4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f4003a00 0x7f04f4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 -- 172.21.15.26:0/449914630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40035b0 con 0x7f04f4004fb0 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.019+0000 7f050ad9d700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f04f400ba10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f050c0ccaa0 tx=0x7f04f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcb2f3b55e7dc62 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400ed90 con 0x7f04f4004fb0 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050400f040 con 0x7f04f4004fb0 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f050959a700 1 -- 172.21.15.26:0/449914630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504003c60 con 0x7f04f4004fb0 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f0510c50700 1 -- 172.21.15.26:0/449914630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 msgr2=0x7f04f400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f0510c50700 1 --2- 172.21.15.26:0/449914630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f04f400ba10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f050c0ccaa0 tx=0x7f04f4005880 comp rx=0 tx=0).stop 2023-06-09T04:39:02.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f050ad9d700 1 -- 172.21.15.26:0/449914630 reap_dead start 2023-06-09T04:39:02.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f0510c50700 1 -- 172.21.15.26:0/449914630 shutdown_connections 2023-06-09T04:39:02.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f0510c50700 1 -- 172.21.15.26:0/449914630 >> 172.21.15.26:0/449914630 conn(0x7f050c0cb9d0 msgr2=0x7f050c0cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f0510c50700 1 -- 172.21.15.26:0/449914630 shutdown_connections 2023-06-09T04:39:02.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.020+0000 7f0510c50700 1 -- 172.21.15.26:0/449914630 wait complete. 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 Processor -- start 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 -- start start 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f050c1f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c0b1d80 0x7f050c14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f050c070aa0 0x7f050c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c071480 con 0x7f04f4004fb0 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1f40a0 con 0x7f050c070aa0 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f0510c50700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0b2260 con 0x7f050c0b1d80 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f050a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f050c1f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f050a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f050c1f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39378/0 (socket says 172.21.15.26:39378) 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.022+0000 7f050a59c700 1 -- 172.21.15.26:0/2541294683 learned_addr learned my addr 172.21.15.26:0/2541294683 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050ad9d700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f050c070aa0 0x7f050c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f0509d9b700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c0b1d80 0x7f050c14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050a59c700 1 -- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c0b1d80 msgr2=0x7f050c14a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050a59c700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c0b1d80 0x7f050c14a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050a59c700 1 -- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f050c070aa0 msgr2=0x7f050c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050a59c700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f050c070aa0 0x7f050c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050a59c700 1 -- 172.21.15.26:0/2541294683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0b2540 con 0x7f04f4004fb0 2023-06-09T04:39:02.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f050a59c700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f050c1f3b60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0500011800 tx=0x7f0500011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500015870 con 0x7f04f4004fb0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05000159d0 con 0x7f04f4004fb0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c0b2820 con 0x7f04f4004fb0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500015d80 con 0x7f04f4004fb0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.023+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c0b2de0 con 0x7f04f4004fb0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.024+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c067180 con 0x7f04f4004fb0 2023-06-09T04:39:02.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.025+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0500005a20 con 0x7f04f4004fb0 2023-06-09T04:39:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.025+0000 7f04faffd700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.025+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0500089d30 con 0x7f04f4004fb0 2023-06-09T04:39:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.025+0000 7f0509d9b700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.026+0000 7f0509d9b700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04ec06ace0 0x7f04ec06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f050c0b2190 tx=0x7f04fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.029+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0500054da0 con 0x7f04f4004fb0 2023-06-09T04:39:02.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.231+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f050c1569f0 con 0x7f04f4004fb0 2023-06-09T04:39:02.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.231+0000 7f04faffd700 1 -- 172.21.15.26:0/2541294683 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05000583c0 con 0x7f04f4004fb0 2023-06-09T04:39:02.232 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:39:02.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04ec06ace0 msgr2=0x7f04ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04ec06ace0 0x7f04ec06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f050c0b2190 tx=0x7f04fc009040 comp rx=0 tx=0).stop 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 msgr2=0x7f050c1f3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f050c1f3b60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0500011800 tx=0x7f0500011bc0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 shutdown_connections 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f050c070aa0 0x7f050c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04f4004fb0 0x7f050c1f3b60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 --2- 172.21.15.26:0/2541294683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f050c0b1d80 0x7f050c14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 >> 172.21.15.26:0/2541294683 conn(0x7f050c0cb9d0 msgr2=0x7f050c1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 shutdown_connections 2023-06-09T04:39:02.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.233+0000 7f0510c50700 1 -- 172.21.15.26:0/2541294683 wait complete. 2023-06-09T04:39:02.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.373+0000 7f7a2cb3e700 1 Processor -- start 2023-06-09T04:39:02.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.373+0000 7f7a2cb3e700 1 -- start start 2023-06-09T04:39:02.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2cb3e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a2815d3e0 0x7f7a280d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2cb3e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7a280d1300 0x7f7a280b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2cb3e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2815d950 con 0x7f7a281569b0 2023-06-09T04:39:02.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2cb3e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a280d0970 con 0x7f7a280d1300 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2cb3e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280cd360 con 0x7f7a2815d3e0 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2659c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7a281569b0 0x7f7a280cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48244/0 (socket says 172.21.15.26:48244) 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2659c700 1 -- 172.21.15.26:0/4292022725 learned_addr learned my addr 172.21.15.26:0/4292022725 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a25d9b700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a2815d3e0 0x7f7a280d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a26d9d700 1 --2- 172.21.15.26:0/4292022725 >> v2:172.21.15.104:3300/0 conn(0x7f7a280d1300 0x7f7a280b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2559a700 1 -- 172.21.15.26:0/4292022725 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685624004 0 0) 0x7f7a2815d950 con 0x7f7a281569b0 2023-06-09T04:39:02.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a2559a700 1 -- 172.21.15.26:0/4292022725 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a100035b0 con 0x7f7a281569b0 2023-06-09T04:39:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a26d9d700 1 -- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a2815d3e0 msgr2=0x7f7a280d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a26d9d700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a2815d3e0 0x7f7a280d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a26d9d700 1 -- 172.21.15.26:0/4292022725 >> v1:172.21.15.26:6789/0 conn(0x7f7a281569b0 legacy=0x7f7a280cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a26d9d700 1 -- 172.21.15.26:0/4292022725 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280cd640 con 0x7f7a280d1300 2023-06-09T04:39:02.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a25d9b700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a2815d3e0 0x7f7a280d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:02.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.374+0000 7f7a26d9d700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a280d1300 0x7f7a280b7a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009d90 tx=0x7f7a2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=992de930c59be3d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2559a700 1 -- 172.21.15.26:0/4292022725 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2000e070 con 0x7f7a280d1300 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2559a700 1 -- 172.21.15.26:0/4292022725 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2000bb20 con 0x7f7a280d1300 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2559a700 1 -- 172.21.15.26:0/4292022725 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20012430 con 0x7f7a280d1300 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a280d1300 msgr2=0x7f7a280b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a280d1300 0x7f7a280b7a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009d90 tx=0x7f7a2000b330 comp rx=0 tx=0).stop 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4292022725 shutdown_connections 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a280d1300 0x7f7a280b7a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4292022725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a2815d3e0 0x7f7a280d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4292022725 >> 172.21.15.26:0/4292022725 conn(0x7f7a2806b1f0 msgr2=0x7f7a2806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4292022725 shutdown_connections 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.375+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4292022725 wait complete. 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 Processor -- start 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 -- start start 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a280d1300 0x7f7a280cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 0x7f7a280b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2815d3e0 0x7f7a28149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281f5680 con 0x7f7a281569b0 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281f5960 con 0x7f7a2815d3e0 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a2cb3e700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281f5c40 con 0x7f7a280d1300 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a25d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 0x7f7a280b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a25d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 0x7f7a280b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39394/0 (socket says 172.21.15.26:39394) 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.377+0000 7f7a25d9b700 1 -- 172.21.15.26:0/4229701414 learned_addr learned my addr 172.21.15.26:0/4229701414 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a2659c700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a280d1300 0x7f7a280cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a26d9d700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2815d3e0 0x7f7a28149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a25d9b700 1 -- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a280d1300 msgr2=0x7f7a280cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a25d9b700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a280d1300 0x7f7a280cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a25d9b700 1 -- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2815d3e0 msgr2=0x7f7a28149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a25d9b700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2815d3e0 0x7f7a28149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a25d9b700 1 -- 172.21.15.26:0/4229701414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0094a0 con 0x7f7a281569b0 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a2659c700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a280d1300 0x7f7a280cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a25d9b700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 0x7f7a280b6290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00ebe0 tx=0x7f7a1c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00c910 con 0x7f7a281569b0 2023-06-09T04:39:02.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00ca70 con 0x7f7a281569b0 2023-06-09T04:39:02.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00cde0 con 0x7f7a281569b0 2023-06-09T04:39:02.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a20009a70 con 0x7f7a281569b0 2023-06-09T04:39:02.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.378+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a281f2ca0 con 0x7f7a281569b0 2023-06-09T04:39:02.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.379+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a28074080 con 0x7f7a281569b0 2023-06-09T04:39:02.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.380+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a1c013470 con 0x7f7a281569b0 2023-06-09T04:39:02.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.380+0000 7f7a16ffd700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7a0806ace0 0x7f7a0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.380+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7a1c089760 con 0x7f7a281569b0 2023-06-09T04:39:02.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.380+0000 7f7a2659c700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7a0806ace0 0x7f7a0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.381+0000 7f7a2659c700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7a0806ace0 0x7f7a0806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a180010e0 tx=0x7f7a18009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.385+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a1c0547d0 con 0x7f7a281569b0 2023-06-09T04:39:02.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.580+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a2815f8f0 con 0x7f7a281569b0 2023-06-09T04:39:02.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.580+0000 7f7a16ffd700 1 -- 172.21.15.26:0/4229701414 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a1c057df0 con 0x7f7a281569b0 2023-06-09T04:39:02.581 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:39:02.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7a0806ace0 msgr2=0x7f7a0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7a0806ace0 0x7f7a0806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a180010e0 tx=0x7f7a18009040 comp rx=0 tx=0).stop 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 msgr2=0x7f7a280b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 0x7f7a280b6290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00ebe0 tx=0x7f7a1c009ec0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 shutdown_connections 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2815d3e0 0x7f7a28149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7a280d1300 0x7f7a280cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7a0806ace0 0x7f7a0806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 --2- 172.21.15.26:0/4229701414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a281569b0 0x7f7a280b6290 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 >> 172.21.15.26:0/4229701414 conn(0x7f7a2806b1f0 msgr2=0x7f7a280d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 shutdown_connections 2023-06-09T04:39:02.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.582+0000 7f7a2cb3e700 1 -- 172.21.15.26:0/4229701414 wait complete. 2023-06-09T04:39:02.595 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:02.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.721+0000 7f7e450f5700 1 Processor -- start 2023-06-09T04:39:02.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.721+0000 7f7e450f5700 1 -- start start 2023-06-09T04:39:02.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e450f5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7e400aed90 0x7f7e400c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e450f5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e400ca370 0x7f7e400ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e450f5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e40159880 con 0x7f7e400ceae0 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e450f5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400ca810 con 0x7f7e400ca370 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e450f5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400cda30 con 0x7f7e400aed90 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3e59c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7e400ca370 0x7f7e400ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3f59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7e400ceae0 0x7f7e400cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48262/0 (socket says 172.21.15.26:48262) 2023-06-09T04:39:02.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3f59e700 1 -- 172.21.15.26:0/3272817962 learned_addr learned my addr 172.21.15.26:0/3272817962 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3ed9d700 1 --2- 172.21.15.26:0/3272817962 >> v2:172.21.15.104:3300/0 conn(0x7f7e400aed90 0x7f7e400c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3e59c700 1 -- 172.21.15.26:0/3272817962 >> v2:172.21.15.104:3300/0 conn(0x7f7e400aed90 msgr2=0x7f7e400c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3e59c700 1 --2- 172.21.15.26:0/3272817962 >> v2:172.21.15.104:3300/0 conn(0x7f7e400aed90 0x7f7e400c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3e59c700 1 -- 172.21.15.26:0/3272817962 >> v1:172.21.15.26:6789/0 conn(0x7f7e400ceae0 legacy=0x7f7e400cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3dd9b700 1 -- 172.21.15.26:0/3272817962 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333406799 0 0) 0x7f7e40159880 con 0x7f7e400ceae0 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3e59c700 1 -- 172.21.15.26:0/3272817962 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4006cff0 con 0x7f7e400ca370 2023-06-09T04:39:02.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.722+0000 7f7e3ed9d700 1 --2- 172.21.15.26:0/3272817962 >> v2:172.21.15.104:3300/0 conn(0x7f7e400aed90 0x7f7e400c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:02.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e3e59c700 1 --2- 172.21.15.26:0/3272817962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ca370 0x7f7e400ce5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7e40070e50 tx=0x7f7e30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c0c30481850d69 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e3dd9b700 1 -- 172.21.15.26:0/3272817962 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011830 con 0x7f7e400ca370 2023-06-09T04:39:02.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e3dd9b700 1 -- 172.21.15.26:0/3272817962 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30011990 con 0x7f7e400ca370 2023-06-09T04:39:02.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e3dd9b700 1 -- 172.21.15.26:0/3272817962 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011d20 con 0x7f7e400ca370 2023-06-09T04:39:02.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 -- 172.21.15.26:0/3272817962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ca370 msgr2=0x7f7e400ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 --2- 172.21.15.26:0/3272817962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ca370 0x7f7e400ce5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7e40070e50 tx=0x7f7e30009b50 comp rx=0 tx=0).stop 2023-06-09T04:39:02.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 -- 172.21.15.26:0/3272817962 shutdown_connections 2023-06-09T04:39:02.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 --2- 172.21.15.26:0/3272817962 >> v2:172.21.15.104:3300/0 conn(0x7f7e400aed90 0x7f7e400c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 --2- 172.21.15.26:0/3272817962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ca370 0x7f7e400ce5a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 -- 172.21.15.26:0/3272817962 >> 172.21.15.26:0/3272817962 conn(0x7f7e40098a30 msgr2=0x7f7e400cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 -- 172.21.15.26:0/3272817962 shutdown_connections 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.723+0000 7f7e450f5700 1 -- 172.21.15.26:0/3272817962 wait complete. 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 Processor -- start 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 -- start start 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e400aed90 0x7f7e401ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7e400ca370 0x7f7e4015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 0x7f7e400c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4015c970 con 0x7f7e400ceae0 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4015bcf0 con 0x7f7e400aed90 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.725+0000 7f7e450f5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4015bfd0 con 0x7f7e400ca370 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 0x7f7e400c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 0x7f7e400c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39410/0 (socket says 172.21.15.26:39410) 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 -- 172.21.15.26:0/2472808891 learned_addr learned my addr 172.21.15.26:0/2472808891 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3e59c700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7e400ca370 0x7f7e4015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3ed9d700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e400aed90 0x7f7e401ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 -- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7e400ca370 msgr2=0x7f7e4015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7e400ca370 0x7f7e4015b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 -- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e400aed90 msgr2=0x7f7e401ef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e400aed90 0x7f7e401ef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 -- 172.21.15.26:0/2472808891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300094a0 con 0x7f7e400ceae0 2023-06-09T04:39:02.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e3f59e700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 0x7f7e400c8a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800cca0 tx=0x7f7e3800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800cea0 con 0x7f7e400ceae0 2023-06-09T04:39:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3800ade0 con 0x7f7e400ceae0 2023-06-09T04:39:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4015c2b0 con 0x7f7e400ceae0 2023-06-09T04:39:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38007310 con 0x7f7e400ceae0 2023-06-09T04:39:02.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.726+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e401ef980 con 0x7f7e400ceae0 2023-06-09T04:39:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.727+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e40067180 con 0x7f7e400ceae0 2023-06-09T04:39:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.728+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e38007470 con 0x7f7e400ceae0 2023-06-09T04:39:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.728+0000 7f7e277fe700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7e2c06ace0 0x7f7e2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.728+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7e38089120 con 0x7f7e400ceae0 2023-06-09T04:39:02.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.728+0000 7f7e3ed9d700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7e2c06ace0 0x7f7e2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.729+0000 7f7e3ed9d700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7e2c06ace0 0x7f7e2c06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c920 tx=0x7f7e34008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.733+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e38054220 con 0x7f7e400ceae0 2023-06-09T04:39:02.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.928+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e400cdf50 con 0x7f7e400ceae0 2023-06-09T04:39:02.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.928+0000 7f7e277fe700 1 -- 172.21.15.26:0/2472808891 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e38057840 con 0x7f7e400ceae0 2023-06-09T04:39:02.929 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:39:02.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7e2c06ace0 msgr2=0x7f7e2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7e2c06ace0 0x7f7e2c06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c920 tx=0x7f7e34008040 comp rx=0 tx=0).stop 2023-06-09T04:39:02.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 msgr2=0x7f7e400c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 0x7f7e400c8a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800cca0 tx=0x7f7e3800a340 comp rx=0 tx=0).stop 2023-06-09T04:39:02.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 shutdown_connections 2023-06-09T04:39:02.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7e2c06ace0 0x7f7e2c06d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e400ceae0 0x7f7e400c8a80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e400aed90 0x7f7e401ef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 --2- 172.21.15.26:0/2472808891 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7e400ca370 0x7f7e4015b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 >> 172.21.15.26:0/2472808891 conn(0x7f7e40098a30 msgr2=0x7f7e400afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 shutdown_connections 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:02.930+0000 7f7e450f5700 1 -- 172.21.15.26:0/2472808891 wait complete. 2023-06-09T04:39:02.944 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:03.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.068+0000 7ff35108f700 1 Processor -- start 2023-06-09T04:39:03.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.068+0000 7ff35108f700 1 -- start start 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff35108f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff34c15c620 0x7ff34c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff35108f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff35108f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0b2130 con 0x7ff34c0aeb20 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff35108f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c0aef90 con 0x7ff34c15c620 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff35108f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c06a9c0 con 0x7ff34c06ea90 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34b59e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff34c15c620 0x7ff34c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff34c15c620 0x7ff34c0ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:46534/0 (socket says 172.21.15.26:46534) 2023-06-09T04:39:03.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 -- 172.21.15.26:0/3215890196 learned_addr learned my addr 172.21.15.26:0/3215890196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:03.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34b59e700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c0ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50076/0 (socket says 172.21.15.26:50076) 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 -- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 msgr2=0x7ff34c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 --2- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c0ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 -- 172.21.15.26:0/3215890196 >> v1:172.21.15.104:6789/0 conn(0x7ff34c0aeb20 legacy=0x7ff34c06e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 -- 172.21.15.26:0/3215890196 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0ac3b0 con 0x7ff34c15c620 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34b59e700 1 --2- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c0ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.069+0000 7ff34ad9d700 1 --2- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c15c620 0x7ff34c0ae5e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a73aef2181a8ac server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff349d9b700 1 -- 172.21.15.26:0/3215890196 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340005e30 con 0x7ff34c15c620 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff349d9b700 1 -- 172.21.15.26:0/3215890196 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff340004030 con 0x7ff34c15c620 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff349d9b700 1 -- 172.21.15.26:0/3215890196 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3400043e0 con 0x7ff34c15c620 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 -- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c15c620 msgr2=0x7ff34c0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 --2- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c15c620 0x7ff34c0ae5e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 -- 172.21.15.26:0/3215890196 shutdown_connections 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 --2- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c0ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 --2- 172.21.15.26:0/3215890196 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c15c620 0x7ff34c0ae5e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 -- 172.21.15.26:0/3215890196 >> 172.21.15.26:0/3215890196 conn(0x7ff34c098b50 msgr2=0x7ff34c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 -- 172.21.15.26:0/3215890196 shutdown_connections 2023-06-09T04:39:03.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.070+0000 7ff35108f700 1 -- 172.21.15.26:0/3215890196 wait complete. 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.072+0000 7ff35108f700 1 Processor -- start 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.072+0000 7ff35108f700 1 -- start start 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff35108f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff35108f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0aeb20 0x7ff34c0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff35108f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 0x7ff34c0adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff35108f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0c3260 con 0x7ff34c15c620 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff35108f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0c3540 con 0x7ff34c0aeb20 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff35108f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0c3820 con 0x7ff34c06ea90 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 0x7ff34c0adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 0x7ff34c0adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39424/0 (socket says 172.21.15.26:39424) 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 -- 172.21.15.26:0/244714461 learned_addr learned my addr 172.21.15.26:0/244714461 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34ad9d700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34a59c700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0aeb20 0x7ff34c0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 -- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 msgr2=0x7ff34c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c1557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 -- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0aeb20 msgr2=0x7ff34c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0aeb20 0x7ff34c0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 -- 172.21.15.26:0/244714461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344009a70 con 0x7ff34c15c620 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34a59c700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0aeb20 0x7ff34c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34ad9d700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.073+0000 7ff34b59e700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 0x7ff34c0adb20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff34400efc0 tx=0x7ff34400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.074+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344009cd0 con 0x7ff34c15c620 2023-06-09T04:39:03.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.074+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34400f040 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.074+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff340009500 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.074+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34400cd60 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.074+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c0c3de0 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.074+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c067180 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.075+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff344014480 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.075+0000 7ff3337fe700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff33806ace0 0x7ff33806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.075+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff344089bb0 con 0x7ff34c15c620 2023-06-09T04:39:03.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.076+0000 7ff34ad9d700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff33806ace0 0x7ff33806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.076+0000 7ff34ad9d700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff33806ace0 0x7ff33806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.080+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff344054c20 con 0x7ff34c15c620 2023-06-09T04:39:03.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.292+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff34c0c3fa0 con 0x7ff34c15c620 2023-06-09T04:39:03.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.292+0000 7ff3337fe700 1 -- 172.21.15.26:0/244714461 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff344058240 con 0x7ff34c15c620 2023-06-09T04:39:03.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff33806ace0 msgr2=0x7ff33806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff33806ace0 0x7ff33806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340008070 comp rx=0 tx=0).stop 2023-06-09T04:39:03.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 msgr2=0x7ff34c0adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 0x7ff34c0adb20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff34400efc0 tx=0x7ff34400c3a0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 shutdown_connections 2023-06-09T04:39:03.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff33806ace0 0x7ff33806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff34c15c620 0x7ff34c0adb20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff34c06ea90 0x7ff34c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 --2- 172.21.15.26:0/244714461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0aeb20 0x7ff34c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.294+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 >> 172.21.15.26:0/244714461 conn(0x7ff34c098b50 msgr2=0x7ff34c0ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.295+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 shutdown_connections 2023-06-09T04:39:03.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.295+0000 7ff35108f700 1 -- 172.21.15.26:0/244714461 wait complete. 2023-06-09T04:39:03.298 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:39:03.308 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2023-06-09T04:39:03.308 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:03.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:03.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.452+0000 7ff4b74d5700 1 Processor -- start 2023-06-09T04:39:03.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.452+0000 7ff4b74d5700 1 -- start start 2023-06-09T04:39:03.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b74d5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff4b00ca540 0x7ff4b00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b74d5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4b00ceae0 0x7ff4b006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b74d5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0159880 con 0x7ff4b00aed90 2023-06-09T04:39:03.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b74d5700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00cda30 con 0x7ff4b00ceae0 2023-06-09T04:39:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b74d5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b006cff0 con 0x7ff4b00ca540 2023-06-09T04:39:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b5a72700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4b00ceae0 0x7ff4b006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b5271700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff4b00aed90 0x7ff4b00c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48286/0 (socket says 172.21.15.26:48286) 2023-06-09T04:39:03.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b5271700 1 -- 172.21.15.26:0/3872056824 learned_addr learned my addr 172.21.15.26:0/3872056824 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:03.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b4a70700 1 --2- 172.21.15.26:0/3872056824 >> v2:172.21.15.104:3300/0 conn(0x7ff4b00ca540 0x7ff4b00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b5a72700 1 -- 172.21.15.26:0/3872056824 >> v2:172.21.15.104:3300/0 conn(0x7ff4b00ca540 msgr2=0x7ff4b00ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b5a72700 1 --2- 172.21.15.26:0/3872056824 >> v2:172.21.15.104:3300/0 conn(0x7ff4b00ca540 0x7ff4b00ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4b5a72700 1 -- 172.21.15.26:0/3872056824 >> v1:172.21.15.26:6789/0 conn(0x7ff4b00aed90 legacy=0x7ff4b00c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.453+0000 7ff4a7fff700 1 -- 172.21.15.26:0/3872056824 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822726903 0 0) 0x7ff4b0159880 con 0x7ff4b00aed90 2023-06-09T04:39:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b5a72700 1 -- 172.21.15.26:0/3872056824 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00cf250 con 0x7ff4b00ceae0 2023-06-09T04:39:03.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b5a72700 1 --2- 172.21.15.26:0/3872056824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ceae0 0x7ff4b006da60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00d0610 tx=0x7ff4a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d615843ae4e5d624 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4a7fff700 1 -- 172.21.15.26:0/3872056824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800e070 con 0x7ff4b00ceae0 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4a7fff700 1 -- 172.21.15.26:0/3872056824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800bbd0 con 0x7ff4b00ceae0 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4a7fff700 1 -- 172.21.15.26:0/3872056824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8012430 con 0x7ff4b00ceae0 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3872056824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ceae0 msgr2=0x7ff4b006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3872056824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ceae0 0x7ff4b006da60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00d0610 tx=0x7ff4a800b330 comp rx=0 tx=0).stop 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3872056824 shutdown_connections 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3872056824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ceae0 0x7ff4b006da60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3872056824 >> v2:172.21.15.104:3300/0 conn(0x7ff4b00ca540 0x7ff4b00ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.454+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3872056824 >> 172.21.15.26:0/3872056824 conn(0x7ff4b0098a30 msgr2=0x7ff4b00cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.455+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3872056824 shutdown_connections 2023-06-09T04:39:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.455+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3872056824 wait complete. 2023-06-09T04:39:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.456+0000 7ff4b74d5700 1 Processor -- start 2023-06-09T04:39:03.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.456+0000 7ff4b74d5700 1 -- start start 2023-06-09T04:39:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.456+0000 7ff4b74d5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4b00aed90 0x7ff4b01e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.456+0000 7ff4b74d5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 0x7ff4b00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b74d5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4b00ceae0 0x7ff4b00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b74d5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01e3a60 con 0x7ff4b00ca540 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b74d5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00b35e0 con 0x7ff4b00aed90 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b74d5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00b38c0 con 0x7ff4b00ceae0 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 0x7ff4b00c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 0x7ff4b00c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39436/0 (socket says 172.21.15.26:39436) 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 -- 172.21.15.26:0/3745938463 learned_addr learned my addr 172.21.15.26:0/3745938463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:03.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b5a72700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4b00ceae0 0x7ff4b00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b5271700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4b00aed90 0x7ff4b01e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 -- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4b00ceae0 msgr2=0x7ff4b00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4b00ceae0 0x7ff4b00b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 -- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4b00aed90 msgr2=0x7ff4b01e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4b00aed90 0x7ff4b01e3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 -- 172.21.15.26:0/3745938463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009a70 con 0x7ff4b00ca540 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b5a72700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4b00ceae0 0x7ff4b00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:03.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b5271700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4b00aed90 0x7ff4b01e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b4a70700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 0x7ff4b00c8740 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c7f0 tx=0x7ff4ac00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac004220 con 0x7ff4b00ca540 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac004380 con 0x7ff4b00ca540 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0036a0 con 0x7ff4b00ca540 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.457+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b00b3ba0 con 0x7ff4b00ca540 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.458+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b01e11d0 con 0x7ff4b00ca540 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.458+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b0067180 con 0x7ff4b00ca540 2023-06-09T04:39:03.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.459+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4ac003800 con 0x7ff4b00ca540 2023-06-09T04:39:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.459+0000 7ff4a5ffb700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff49406ace0 0x7ff49406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.459+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff4ac088fe0 con 0x7ff4b00ca540 2023-06-09T04:39:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.459+0000 7ff4b5271700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff49406ace0 0x7ff49406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.460+0000 7ff4b5271700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff49406ace0 0x7ff49406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0001730 tx=0x7ff4a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.464+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4ac054050 con 0x7ff4b00ca540 2023-06-09T04:39:03.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.663+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4b01df4f0 con 0x7ff4b00ca540 2023-06-09T04:39:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.664+0000 7ff4a5ffb700 1 -- 172.21.15.26:0/3745938463 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7ff4ac057670 con 0x7ff4b00ca540 2023-06-09T04:39:03.665 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:03.666 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:59.131950+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:03.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff49406ace0 msgr2=0x7ff49406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff49406ace0 0x7ff49406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0001730 tx=0x7ff4a0009040 comp rx=0 tx=0).stop 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 msgr2=0x7ff4b00c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 0x7ff4b00c8740 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c7f0 tx=0x7ff4ac00cbb0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 shutdown_connections 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4b00ceae0 0x7ff4b00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4b00aed90 0x7ff4b01e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff49406ace0 0x7ff49406d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 --2- 172.21.15.26:0/3745938463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4b00ca540 0x7ff4b00c8740 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 >> 172.21.15.26:0/3745938463 conn(0x7ff4b0098a30 msgr2=0x7ff4b006d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 shutdown_connections 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.666+0000 7ff4b74d5700 1 -- 172.21.15.26:0/3745938463 wait complete. 2023-06-09T04:39:03.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:39:03.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.807+0000 7fd3ae340700 1 Processor -- start 2023-06-09T04:39:03.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.807+0000 7fd3ae340700 1 -- start start 2023-06-09T04:39:03.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ae340700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ae340700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3a806e990 0x7fd3a806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ae340700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a806f190 con 0x7fd3a815c6e0 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ae340700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a806e440 con 0x7fd3a806e990 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ae340700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a806e690 con 0x7fd3a80aed50 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ac8dd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3a806e990 0x7fd3a806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3a7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd3a815c6e0 0x7fd3a80ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48300/0 (socket says 172.21.15.26:48300) 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3a7fff700 1 -- 172.21.15.26:0/2061584636 learned_addr learned my addr 172.21.15.26:0/2061584636 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:03.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3a77fe700 1 --2- 172.21.15.26:0/2061584636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ac8dd700 1 -- 172.21.15.26:0/2061584636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 msgr2=0x7fd3a8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ac8dd700 1 --2- 172.21.15.26:0/2061584636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a8069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ac8dd700 1 -- 172.21.15.26:0/2061584636 >> v1:172.21.15.26:6789/0 conn(0x7fd3a815c6e0 legacy=0x7fd3a80ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3ac8dd700 1 -- 172.21.15.26:0/2061584636 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8160300 con 0x7fd3a806e990 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.808+0000 7fd3a6ffd700 1 -- 172.21.15.26:0/2061584636 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771748381 0 0) 0x7fd3a806f190 con 0x7fd3a815c6e0 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ac8dd700 1 --2- 172.21.15.26:0/2061584636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a806a2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009d90 tx=0x7fd3a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b416dc8841785ee0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3a6ffd700 1 -- 172.21.15.26:0/2061584636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000e070 con 0x7fd3a806e990 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3a6ffd700 1 -- 172.21.15.26:0/2061584636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a000bbd0 con 0x7fd3a806e990 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3a6ffd700 1 -- 172.21.15.26:0/2061584636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0012430 con 0x7fd3a806e990 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 -- 172.21.15.26:0/2061584636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 msgr2=0x7fd3a806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 --2- 172.21.15.26:0/2061584636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a806a2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009d90 tx=0x7fd3a000b330 comp rx=0 tx=0).stop 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 -- 172.21.15.26:0/2061584636 shutdown_connections 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 --2- 172.21.15.26:0/2061584636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a806a2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 --2- 172.21.15.26:0/2061584636 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a8069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 -- 172.21.15.26:0/2061584636 >> 172.21.15.26:0/2061584636 conn(0x7fd3a8098a30 msgr2=0x7fd3a80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 -- 172.21.15.26:0/2061584636 shutdown_connections 2023-06-09T04:39:03.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.809+0000 7fd3ae340700 1 -- 172.21.15.26:0/2061584636 wait complete. 2023-06-09T04:39:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.811+0000 7fd3ae340700 1 Processor -- start 2023-06-09T04:39:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.811+0000 7fd3ae340700 1 -- start start 2023-06-09T04:39:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.811+0000 7fd3ae340700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a8153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a815c6e0 0x7fd3a81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80afeb0 con 0x7fd3a806e990 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80af2a0 con 0x7fd3a815c6e0 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80af580 con 0x7fd3a80aed50 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a8153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a8153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39448/0 (socket says 172.21.15.26:39448) 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1825993172 learned_addr learned my addr 172.21.15.26:0/1825993172 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 msgr2=0x7fd3a815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a815c6e0 msgr2=0x7fd3a81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a815c6e0 0x7fd3a81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 -- 172.21.15.26:0/1825993172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009a70 con 0x7fd3a806e990 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a7fff700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a8153b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3900010e0 tx=0x7fd39000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900074e0 con 0x7fd3a806e990 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390007640 con 0x7fd3a806e990 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a80af860 con 0x7fd3a806e990 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390005a70 con 0x7fd3a806e990 2023-06-09T04:39:03.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.812+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a8154040 con 0x7fd3a806e990 2023-06-09T04:39:03.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.813+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a8067180 con 0x7fd3a806e990 2023-06-09T04:39:03.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.814+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd390005bd0 con 0x7fd3a806e990 2023-06-09T04:39:03.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.814+0000 7fd3a4ff9700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd38806ace0 0x7fd38806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.814+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd390088a00 con 0x7fd3a806e990 2023-06-09T04:39:03.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.814+0000 7fd3a77fe700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd38806ace0 0x7fd38806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.815+0000 7fd3a77fe700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd38806ace0 0x7fd38806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8072060 tx=0x7fd398008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:03.819+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd390053b00 con 0x7fd3a806e990 2023-06-09T04:39:04.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.016+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3a80ce6f0 con 0x7fd3a806e990 2023-06-09T04:39:04.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.016+0000 7fd3a4ff9700 1 -- 172.21.15.26:0/1825993172 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd390017020 con 0x7fd3a806e990 2023-06-09T04:39:04.017 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:39:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd38806ace0 msgr2=0x7fd38806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd38806ace0 0x7fd38806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8072060 tx=0x7fd398008040 comp rx=0 tx=0).stop 2023-06-09T04:39:04.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 msgr2=0x7fd3a8153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a8153b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3900010e0 tx=0x7fd39000cae0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 shutdown_connections 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a815c6e0 0x7fd3a81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fd38806ace0 0x7fd38806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a806e990 0x7fd3a8153b00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 --2- 172.21.15.26:0/1825993172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a80aed50 0x7fd3a815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 >> 172.21.15.26:0/1825993172 conn(0x7fd3a8098a30 msgr2=0x7fd3a81587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 shutdown_connections 2023-06-09T04:39:04.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.018+0000 7fd3ae340700 1 -- 172.21.15.26:0/1825993172 wait complete. 2023-06-09T04:39:04.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.158+0000 7fe2b6b6b700 1 Processor -- start 2023-06-09T04:39:04.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.158+0000 7fe2b6b6b700 1 -- start start 2023-06-09T04:39:04.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b6b6b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2b01569b0 0x7fe2b00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b6b6b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b00cf370 0x7fe2b00d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b6b6b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b015d950 con 0x7fe2b015d3e0 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b6b6b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00d0970 con 0x7fe2b01569b0 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b6b6b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00cd360 con 0x7fe2b00cf370 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2b01569b0 0x7fe2b00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2b01569b0 0x7fe2b00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39456/0 (socket says 172.21.15.26:39456) 2023-06-09T04:39:04.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 -- 172.21.15.26:0/764361069 learned_addr learned my addr 172.21.15.26:0/764361069 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2affff700 1 --2- 172.21.15.26:0/764361069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b00cf370 0x7fe2b00d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 -- 172.21.15.26:0/764361069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b00cf370 msgr2=0x7fe2b00d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 --2- 172.21.15.26:0/764361069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b00cf370 0x7fe2b00d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 -- 172.21.15.26:0/764361069 >> v1:172.21.15.104:6789/0 conn(0x7fe2b015d3e0 legacy=0x7fe2b00b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 -- 172.21.15.26:0/764361069 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00cd640 con 0x7fe2b01569b0 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.159+0000 7fe2b4907700 1 --2- 172.21.15.26:0/764361069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b01569b0 0x7fe2b00cee30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006fd0 tx=0x7fe2a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3bdd1b15735c17 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2af7fe700 1 -- 172.21.15.26:0/764361069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4005e30 con 0x7fe2b01569b0 2023-06-09T04:39:04.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2af7fe700 1 -- 172.21.15.26:0/764361069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4004030 con 0x7fe2b01569b0 2023-06-09T04:39:04.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2af7fe700 1 -- 172.21.15.26:0/764361069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40043e0 con 0x7fe2b01569b0 2023-06-09T04:39:04.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/764361069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b01569b0 msgr2=0x7fe2b00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/764361069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b01569b0 0x7fe2b00cee30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006fd0 tx=0x7fe2a4009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/764361069 shutdown_connections 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/764361069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b01569b0 0x7fe2b00cee30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/764361069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b00cf370 0x7fe2b00d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/764361069 >> 172.21.15.26:0/764361069 conn(0x7fe2b006b1f0 msgr2=0x7fe2b006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/764361069 shutdown_connections 2023-06-09T04:39:04.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.160+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/764361069 wait complete. 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.161+0000 7fe2b6b6b700 1 Processor -- start 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.161+0000 7fe2b6b6b700 1 -- start start 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b6b6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 0x7fe2b01512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b6b6b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b01569b0 0x7fe2b00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b6b6b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b015d3e0 0x7fe2b00b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b6b6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b01f6390 con 0x7fe2b00cf370 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b6b6b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00b8a00 con 0x7fe2b015d3e0 2023-06-09T04:39:04.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b6b6b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b01f5780 con 0x7fe2b01569b0 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b4907700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 0x7fe2b01512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b4907700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 0x7fe2b01512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39460/0 (socket says 172.21.15.26:39460) 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.162+0000 7fe2b4907700 1 -- 172.21.15.26:0/2751899572 learned_addr learned my addr 172.21.15.26:0/2751899572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b4907700 1 -- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b01569b0 msgr2=0x7fe2b00c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b4907700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b01569b0 0x7fe2b00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b4907700 1 -- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b015d3e0 msgr2=0x7fe2b00b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b4907700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b015d3e0 0x7fe2b00b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b4907700 1 -- 172.21.15.26:0/2751899572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009500 con 0x7fe2b00cf370 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b4907700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 0x7fe2b01512f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009840 tx=0x7fe2a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4003d90 con 0x7fe2b00cf370 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4011420 con 0x7fe2b00cf370 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b01f5a60 con 0x7fe2b00cf370 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40117d0 con 0x7fe2b00cf370 2023-06-09T04:39:04.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.163+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b01f6020 con 0x7fe2b00cf370 2023-06-09T04:39:04.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.164+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b0074080 con 0x7fe2b00cf370 2023-06-09T04:39:04.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.165+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2a4011930 con 0x7fe2b00cf370 2023-06-09T04:39:04.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.165+0000 7fe2ad7fa700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe29406ace0 0x7fe29406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.165+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe2a408a6a0 con 0x7fe2b00cf370 2023-06-09T04:39:04.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.165+0000 7fe2affff700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe29406ace0 0x7fe29406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.166+0000 7fe2affff700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe29406ace0 0x7fe29406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe2b015c350 tx=0x7fe29c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.169+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2a40558c0 con 0x7fe2b00cf370 2023-06-09T04:39:04.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.367+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2b00c6420 con 0x7fe2b00cf370 2023-06-09T04:39:04.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.367+0000 7fe2ad7fa700 1 -- 172.21.15.26:0/2751899572 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2a4058ee0 con 0x7fe2b00cf370 2023-06-09T04:39:04.368 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:39:04.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe29406ace0 msgr2=0x7fe29406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe29406ace0 0x7fe29406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe2b015c350 tx=0x7fe29c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:04.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 msgr2=0x7fe2b01512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 0x7fe2b01512f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009840 tx=0x7fe2a4004750 comp rx=0 tx=0).stop 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 shutdown_connections 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b015d3e0 0x7fe2b00b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe29406ace0 0x7fe29406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b00cf370 0x7fe2b01512f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 --2- 172.21.15.26:0/2751899572 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe2b01569b0 0x7fe2b00c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 >> 172.21.15.26:0/2751899572 conn(0x7fe2b006b1f0 msgr2=0x7fe2b00d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 shutdown_connections 2023-06-09T04:39:04.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.369+0000 7fe2b6b6b700 1 -- 172.21.15.26:0/2751899572 wait complete. 2023-06-09T04:39:04.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.508+0000 7f0460634700 1 Processor -- start 2023-06-09T04:39:04.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.508+0000 7f0460634700 1 -- start start 2023-06-09T04:39:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f0460634700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0458159140 0x7f04580cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f0460634700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580ae220 0x7f04580cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f0460634700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04580ad180 con 0x7f04580aed90 2023-06-09T04:39:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f0460634700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580ad460 con 0x7f0458159140 2023-06-09T04:39:04.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f0460634700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04580ad740 con 0x7f04580ae220 2023-06-09T04:39:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f045e3d0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0458159140 0x7f04580cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.509+0000 7f045dbcf700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580ae220 0x7f04580cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0458159140 0x7f04580cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:46588/0 (socket says 172.21.15.26:46588) 2023-06-09T04:39:04.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 -- 172.21.15.26:0/1902923139 learned_addr learned my addr 172.21.15.26:0/1902923139 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 -- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580ae220 msgr2=0x7f04580cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 --2- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580ae220 0x7f04580cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 -- 172.21.15.26:0/1902923139 >> v1:172.21.15.104:6789/0 conn(0x7f04580aed90 legacy=0x7f04580b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 -- 172.21.15.26:0/1902923139 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580ada20 con 0x7f0458159140 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045e3d0700 1 --2- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580cd300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0448006fd0 tx=0x7f044800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d78f26d290c0cb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045d3ce700 1 -- 172.21.15.26:0/1902923139 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448005e30 con 0x7f0458159140 2023-06-09T04:39:04.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045d3ce700 1 -- 172.21.15.26:0/1902923139 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448004030 con 0x7f0458159140 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.510+0000 7f045d3ce700 1 -- 172.21.15.26:0/1902923139 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480043e0 con 0x7f0458159140 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 -- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 msgr2=0x7f04580cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 --2- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580cd300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0448006fd0 tx=0x7f044800be70 comp rx=0 tx=0).stop 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 -- 172.21.15.26:0/1902923139 shutdown_connections 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 --2- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580cd300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 --2- 172.21.15.26:0/1902923139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580ae220 0x7f04580cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 -- 172.21.15.26:0/1902923139 >> 172.21.15.26:0/1902923139 conn(0x7f0458098b50 msgr2=0x7f04580cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 -- 172.21.15.26:0/1902923139 shutdown_connections 2023-06-09T04:39:04.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.511+0000 7f0460634700 1 -- 172.21.15.26:0/1902923139 wait complete. 2023-06-09T04:39:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.513+0000 7f0460634700 1 Processor -- start 2023-06-09T04:39:04.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.513+0000 7f0460634700 1 -- start start 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.513+0000 7f0460634700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 0x7f045815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580aed90 0x7f045815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580b43f0 con 0x7f04580ae220 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580b3770 con 0x7f0458159140 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04580b3a50 con 0x7f04580aed90 2023-06-09T04:39:04.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 0x7f045815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 0x7f045815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39474/0 (socket says 172.21.15.26:39474) 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 -- 172.21.15.26:0/374567500 learned_addr learned my addr 172.21.15.26:0/374567500 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045ebd1700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045dbcf700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580aed90 0x7f045815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 -- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580aed90 msgr2=0x7f045815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580aed90 0x7f045815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 -- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 msgr2=0x7f04580b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 -- 172.21.15.26:0/374567500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044800b7a0 con 0x7f04580ae220 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f045e3d0700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 0x7f045815a180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f044800b340 tx=0x7f0448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044801e070 con 0x7f04580ae220 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04480038b0 con 0x7f04580ae220 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0458159690 con 0x7f04580ae220 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448003c80 con 0x7f04580ae220 2023-06-09T04:39:04.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.514+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04580b4010 con 0x7f04580ae220 2023-06-09T04:39:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.515+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04580b4530 con 0x7f04580ae220 2023-06-09T04:39:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.516+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0448022410 con 0x7f04580ae220 2023-06-09T04:39:04.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.516+0000 7f044effd700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f043c06ace0 0x7f043c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.516+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f044808a400 con 0x7f04580ae220 2023-06-09T04:39:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.517+0000 7f045dbcf700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f043c06ace0 0x7f043c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.517+0000 7f045dbcf700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f043c06ace0 0x7f043c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0454009b70 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.521+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f04580b4530 con 0x7f04580ae220 2023-06-09T04:39:04.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.716+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04580b4530 con 0x7f04580ae220 2023-06-09T04:39:04.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.717+0000 7f044effd700 1 -- 172.21.15.26:0/374567500 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04580b4530 con 0x7f04580ae220 2023-06-09T04:39:04.718 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:39:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f043c06ace0 msgr2=0x7f043c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f043c06ace0 0x7f043c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0454009b70 tx=0x7f0454008040 comp rx=0 tx=0).stop 2023-06-09T04:39:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 msgr2=0x7f045815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 0x7f045815a180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f044800b340 tx=0x7f0448004750 comp rx=0 tx=0).stop 2023-06-09T04:39:04.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 shutdown_connections 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0458159140 0x7f04580b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f043c06ace0 0x7f043c06d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04580ae220 0x7f045815a180 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 --2- 172.21.15.26:0/374567500 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f04580aed90 0x7f045815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 >> 172.21.15.26:0/374567500 conn(0x7f0458098b50 msgr2=0x7f0458069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 shutdown_connections 2023-06-09T04:39:04.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.719+0000 7f0460634700 1 -- 172.21.15.26:0/374567500 wait complete. 2023-06-09T04:39:04.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.858+0000 7f5e086c7700 1 Processor -- start 2023-06-09T04:39:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.858+0000 7f5e086c7700 1 -- start start 2023-06-09T04:39:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e086c7700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5e000ceba0 0x7f5e000d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e086c7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e000ad470 con 0x7f5e0015d820 2023-06-09T04:39:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e086c7700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e000adff0 con 0x7f5e000d0db0 2023-06-09T04:39:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e086c7700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000d1230 con 0x7f5e000ceba0 2023-06-09T04:39:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e06463700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e0015d820 0x7f5e000b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48340/0 (socket says 172.21.15.26:48340) 2023-06-09T04:39:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e06463700 1 -- 172.21.15.26:0/3057845140 learned_addr learned my addr 172.21.15.26:0/3057845140 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05c62700 1 --2- 172.21.15.26:0/3057845140 >> v2:172.21.15.104:3300/0 conn(0x7f5e000ceba0 0x7f5e000d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430091905 0 0) 0x7f5e000ad470 con 0x7f5e0015d820 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dec0035b0 con 0x7f5e0015d820 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168419811 0 0) 0x7f5dec0035b0 con 0x7f5e0015d820 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 >> v2:172.21.15.104:3300/0 conn(0x7f5e000ceba0 msgr2=0x7f5e000d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 --2- 172.21.15.26:0/3057845140 >> v2:172.21.15.104:3300/0 conn(0x7f5e000ceba0 0x7f5e000d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 >> v1:172.21.15.104:6789/0 conn(0x7f5e000d0db0 legacy=0x7f5e000ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000cf040 con 0x7f5e0015d820 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f5df0001670 con 0x7f5e0015d820 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 >> v1:172.21.15.26:6789/0 conn(0x7f5e0015d820 legacy=0x7f5e000b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5dec003a00 0x7f5dec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec004850 0x7f5dec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5dec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000d1230 con 0x7f5dec005320 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.859+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec00c250 con 0x7f5dec004850 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec00c410 con 0x7f5dec003a00 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5dec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06463700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5dec003a00 0x7f5dec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e05c62700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec004850 0x7f5dec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 -- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5dec003a00 msgr2=0x7f5dec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5dec003a00 0x7f5dec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 -- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec004850 msgr2=0x7f5dec004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec004850 0x7f5dec004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 -- 172.21.15.26:0/3057845140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0035b0 con 0x7f5dec005320 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 -- 172.21.15.26:0/3057845140 reap_dead start 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e06c64700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5dec00ba10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c190 tx=0x7f5dec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1aab8c1980c91 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8001db0 con 0x7f5dec005320 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df800ccf0 con 0x7f5dec005320 2023-06-09T04:39:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.860+0000 7f5e05461700 1 -- 172.21.15.26:0/3057845140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8003c40 con 0x7f5dec005320 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 -- 172.21.15.26:0/3057845140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 msgr2=0x7f5dec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5dec00ba10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c190 tx=0x7f5dec005880 comp rx=0 tx=0).stop 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 -- 172.21.15.26:0/3057845140 shutdown_connections 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 --2- 172.21.15.26:0/3057845140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5dec00ba10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 -- 172.21.15.26:0/3057845140 >> 172.21.15.26:0/3057845140 conn(0x7f5e00089fc0 msgr2=0x7f5e0008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 -- 172.21.15.26:0/3057845140 shutdown_connections 2023-06-09T04:39:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.861+0000 7f5e086c7700 1 -- 172.21.15.26:0/3057845140 wait complete. 2023-06-09T04:39:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.862+0000 7f5e086c7700 1 Processor -- start 2023-06-09T04:39:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.862+0000 7f5e086c7700 1 -- start start 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e086c7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5e001eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e086c7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e000c4410 0x7f5e000c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e086c7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e001f1c20 0x7f5e001f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e086c7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000c4dc0 con 0x7f5dec005320 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e086c7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001f2950 con 0x7f5e000c4410 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e086c7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0014f240 con 0x7f5e001f1c20 2023-06-09T04:39:04.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5e001eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5e001eedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39494/0 (socket says 172.21.15.26:39494) 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 -- 172.21.15.26:0/1742872426 learned_addr learned my addr 172.21.15.26:0/1742872426 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e05c62700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e000c4410 0x7f5e000c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06c64700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e001f1c20 0x7f5e001f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 -- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e001f1c20 msgr2=0x7f5e001f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e001f1c20 0x7f5e001f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 -- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e000c4410 msgr2=0x7f5e000c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e000c4410 0x7f5e000c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 -- 172.21.15.26:0/1742872426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0014e480 con 0x7f5dec005320 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.863+0000 7f5e06463700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5e001eedd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5df00072c0 tx=0x7f5df00075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.864+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000f6c0 con 0x7f5dec005320 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.864+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000f820 con 0x7f5dec005320 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.864+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0014e760 con 0x7f5dec005320 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.864+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000fbd0 con 0x7f5dec005320 2023-06-09T04:39:04.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.864+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0014ed20 con 0x7f5dec005320 2023-06-09T04:39:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.865+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e00143670 con 0x7f5dec005320 2023-06-09T04:39:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.865+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5df000fd30 con 0x7f5dec005320 2023-06-09T04:39:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.866+0000 7f5df6ffd700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5de406ace0 0x7f5de406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.866+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5df0089250 con 0x7f5dec005320 2023-06-09T04:39:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.866+0000 7f5e05c62700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5de406ace0 0x7f5de406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.866+0000 7f5e05c62700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5de406ace0 0x7f5de406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009be0 tx=0x7f5dfc009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:04.870+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5df0054400 con 0x7f5dec005320 2023-06-09T04:39:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.064+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e000b0eb0 con 0x7f5dec005320 2023-06-09T04:39:05.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.064+0000 7f5df6ffd700 1 -- 172.21.15.26:0/1742872426 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5df0057a20 con 0x7f5dec005320 2023-06-09T04:39:05.066 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:39:05.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5de406ace0 msgr2=0x7f5de406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5de406ace0 0x7f5de406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009be0 tx=0x7f5dfc009210 comp rx=0 tx=0).stop 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 msgr2=0x7f5e001eedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5e001eedd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5df00072c0 tx=0x7f5df00075d0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 shutdown_connections 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e001f1c20 0x7f5e001f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5de406ace0 0x7f5de406d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5dec005320 0x7f5e001eedd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 --2- 172.21.15.26:0/1742872426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e000c4410 0x7f5e000c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 >> 172.21.15.26:0/1742872426 conn(0x7f5e00089fc0 msgr2=0x7f5e000b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 shutdown_connections 2023-06-09T04:39:05.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.066+0000 7f5e086c7700 1 -- 172.21.15.26:0/1742872426 wait complete. 2023-06-09T04:39:05.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.204+0000 7efca51d9700 1 Processor -- start 2023-06-09T04:39:05.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.204+0000 7efca51d9700 1 -- start start 2023-06-09T04:39:05.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efca51d9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efca00aedc0 0x7efca015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efca51d9700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efca015dd30 0x7efca015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efca51d9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca00b1500 con 0x7efca00ce520 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efca51d9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca015e8a0 con 0x7efca00aedc0 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efca51d9700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca015a8d0 con 0x7efca015dd30 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efca00aedc0 0x7efca015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9f59e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efca00ce520 0x7efca00ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48360/0 (socket says 172.21.15.26:48360) 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9f59e700 1 -- 172.21.15.26:0/2923400274 learned_addr learned my addr 172.21.15.26:0/2923400274 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9e59c700 1 --2- 172.21.15.26:0/2923400274 >> v2:172.21.15.104:3300/0 conn(0x7efca015dd30 0x7efca015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9ed9d700 1 -- 172.21.15.26:0/2923400274 >> v2:172.21.15.104:3300/0 conn(0x7efca015dd30 msgr2=0x7efca015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9ed9d700 1 --2- 172.21.15.26:0/2923400274 >> v2:172.21.15.104:3300/0 conn(0x7efca015dd30 0x7efca015e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9ed9d700 1 -- 172.21.15.26:0/2923400274 >> v1:172.21.15.26:6789/0 conn(0x7efca00ce520 legacy=0x7efca00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9ed9d700 1 -- 172.21.15.26:0/2923400274 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca015abb0 con 0x7efca00aedc0 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.205+0000 7efc9dd9b700 1 -- 172.21.15.26:0/2923400274 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367920793 0 0) 0x7efca00b1500 con 0x7efca00ce520 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efc9ed9d700 1 --2- 172.21.15.26:0/2923400274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00aedc0 0x7efca015b3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efca0073c30 tx=0x7efc94009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b395862d6d0f28 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efc9dd9b700 1 -- 172.21.15.26:0/2923400274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94005e30 con 0x7efca00aedc0 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efc9dd9b700 1 -- 172.21.15.26:0/2923400274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94006030 con 0x7efca00aedc0 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efc9dd9b700 1 -- 172.21.15.26:0/2923400274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc940063c0 con 0x7efca00aedc0 2023-06-09T04:39:05.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 -- 172.21.15.26:0/2923400274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00aedc0 msgr2=0x7efca015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 --2- 172.21.15.26:0/2923400274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00aedc0 0x7efca015b3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efca0073c30 tx=0x7efc94009b00 comp rx=0 tx=0).stop 2023-06-09T04:39:05.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 -- 172.21.15.26:0/2923400274 shutdown_connections 2023-06-09T04:39:05.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 --2- 172.21.15.26:0/2923400274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00aedc0 0x7efca015b3b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 --2- 172.21.15.26:0/2923400274 >> v2:172.21.15.104:3300/0 conn(0x7efca015dd30 0x7efca015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 -- 172.21.15.26:0/2923400274 >> 172.21.15.26:0/2923400274 conn(0x7efca0098b50 msgr2=0x7efca00cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 -- 172.21.15.26:0/2923400274 shutdown_connections 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.206+0000 7efca51d9700 1 -- 172.21.15.26:0/2923400274 wait complete. 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.208+0000 7efca51d9700 1 Processor -- start 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.208+0000 7efca51d9700 1 -- start start 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efca51d9700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efca00aedc0 0x7efca0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efca51d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 0x7efca0150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efca51d9700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efca015dd30 0x7efca00ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efca51d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00b3660 con 0x7efca00ce520 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efca51d9700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00c7570 con 0x7efca00aedc0 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efca51d9700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca00b2b70 con 0x7efca015dd30 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 0x7efca0150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 0x7efca0150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39508/0 (socket says 172.21.15.26:39508) 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 -- 172.21.15.26:0/2973760617 learned_addr learned my addr 172.21.15.26:0/2973760617 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9ed9d700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efca00aedc0 0x7efca0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9f59e700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efca015dd30 0x7efca00ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 -- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efca015dd30 msgr2=0x7efca00ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efca015dd30 0x7efca00ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 -- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efca00aedc0 msgr2=0x7efca0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efca00aedc0 0x7efca0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 -- 172.21.15.26:0/2973760617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94009430 con 0x7efca00ce520 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9ed9d700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efca00aedc0 0x7efca0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.209+0000 7efc9e59c700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 0x7efca0150bc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efc9000e870 tx=0x7efc9000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.210+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90009590 con 0x7efca00ce520 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.210+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000ee70 con 0x7efca00ce520 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.210+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca00b30a0 con 0x7efca00ce520 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.210+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000ca50 con 0x7efca00ce520 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.210+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca01503d0 con 0x7efca00ce520 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.211+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca00b2130 con 0x7efca00ce520 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.211+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc9000cbb0 con 0x7efca00ce520 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.211+0000 7efc877fe700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc8c06ace0 0x7efc8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.212+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efc90089400 con 0x7efca00ce520 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.212+0000 7efc9ed9d700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc8c06ace0 0x7efc8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.212+0000 7efc9ed9d700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc8c06ace0 0x7efc8c06d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc94008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.216+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efc90057f90 con 0x7efca00ce520 2023-06-09T04:39:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.429+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efca00c76e0 con 0x7efca00ce520 2023-06-09T04:39:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.429+0000 7efc877fe700 1 -- 172.21.15.26:0/2973760617 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7efc9000ce60 con 0x7efca00ce520 2023-06-09T04:39:05.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc8c06ace0 msgr2=0x7efc8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc8c06ace0 0x7efc8c06d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc94008070 comp rx=0 tx=0).stop 2023-06-09T04:39:05.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 msgr2=0x7efca0150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 0x7efca0150bc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efc9000e870 tx=0x7efc9000ec30 comp rx=0 tx=0).stop 2023-06-09T04:39:05.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 shutdown_connections 2023-06-09T04:39:05.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efca015dd30 0x7efca00ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efca00aedc0 0x7efca0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7efc8c06ace0 0x7efc8c06d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 --2- 172.21.15.26:0/2973760617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efca00ce520 0x7efca0150bc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.431+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 >> 172.21.15.26:0/2973760617 conn(0x7efca0098b50 msgr2=0x7efca00c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.432+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 shutdown_connections 2023-06-09T04:39:05.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.432+0000 7efca51d9700 1 -- 172.21.15.26:0/2973760617 wait complete. 2023-06-09T04:39:05.435 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2023-06-09T04:39:05.445 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2023-06-09T04:39:05.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:05.445 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-06-09T04:39:05.486 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:05.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2023-06-09T04:39:05.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:05.487 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T04:39:05.545 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-09T04:39:05.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.669+0000 7fba5ad68700 1 Processor -- start 2023-06-09T04:39:05.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.669+0000 7fba5ad68700 1 -- start start 2023-06-09T04:39:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba5ad68700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba540b5930 0x7fba540cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba5ad68700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540cf350 con 0x7fba5415c440 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba5ad68700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540cd1d0 con 0x7fba540b4c70 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba5ad68700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba540cd4b0 con 0x7fba540b5930 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba58b04700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fba5415c440 0x7fba540b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48372/0 (socket says 172.21.15.26:48372) 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba58b04700 1 -- 172.21.15.26:0/1353606968 learned_addr learned my addr 172.21.15.26:0/1353606968 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba59305700 1 --2- 172.21.15.26:0/1353606968 >> v2:172.21.15.104:3300/0 conn(0x7fba540b5930 0x7fba540cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303959172 0 0) 0x7fba540cf350 con 0x7fba5415c440 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.670+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba440035b0 con 0x7fba5415c440 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329425912 0 0) 0x7fba440035b0 con 0x7fba5415c440 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 >> v2:172.21.15.104:3300/0 conn(0x7fba540b5930 msgr2=0x7fba540cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 --2- 172.21.15.26:0/1353606968 >> v2:172.21.15.104:3300/0 conn(0x7fba540b5930 0x7fba540cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 >> v1:172.21.15.104:6789/0 conn(0x7fba540b4c70 legacy=0x7fba540d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540cd790 con 0x7fba5415c440 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fba48001670 con 0x7fba5415c440 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 >> v1:172.21.15.26:6789/0 conn(0x7fba5415c440 legacy=0x7fba540b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba44003a00 0x7fba44003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba44004850 0x7fba44004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba4400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540cd4b0 con 0x7fba44005200 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4400c110 con 0x7fba44004850 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4400c2d0 con 0x7fba44003a00 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba4400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba53fff700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba44004850 0x7fba44004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba58b04700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba44003a00 0x7fba44003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 -- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba44003a00 msgr2=0x7fba44003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba44003a00 0x7fba44003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 -- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba44004850 msgr2=0x7fba44004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba44004850 0x7fba44004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 -- 172.21.15.26:0/1353606968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440035b0 con 0x7fba44005200 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 -- 172.21.15.26:0/1353606968 reap_dead start 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba59305700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba4400ba10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fba54069e40 tx=0x7fba44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e891ed09e67e6396 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.671+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c018070 con 0x7fba44005200 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00f040 con 0x7fba44005200 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba537fe700 1 -- 172.21.15.26:0/1353606968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00ec10 con 0x7fba44005200 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 -- 172.21.15.26:0/1353606968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 msgr2=0x7fba4400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba4400ba10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fba54069e40 tx=0x7fba44005880 comp rx=0 tx=0).stop 2023-06-09T04:39:05.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 -- 172.21.15.26:0/1353606968 shutdown_connections 2023-06-09T04:39:05.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1353606968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba4400ba10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 -- 172.21.15.26:0/1353606968 >> 172.21.15.26:0/1353606968 conn(0x7fba540cf560 msgr2=0x7fba540cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 -- 172.21.15.26:0/1353606968 shutdown_connections 2023-06-09T04:39:05.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.672+0000 7fba5ad68700 1 -- 172.21.15.26:0/1353606968 wait complete. 2023-06-09T04:39:05.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.673+0000 7fba5ad68700 1 Processor -- start 2023-06-09T04:39:05.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.673+0000 7fba5ad68700 1 -- start start 2023-06-09T04:39:05.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba5ad68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba541e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba5ad68700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba541e67b0 0x7fba540b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba5ad68700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba540b39d0 0x7fba541f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba5ad68700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba541e6c20 con 0x7fba44005200 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba5ad68700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540b3e40 con 0x7fba541e67b0 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba5ad68700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba541549d0 con 0x7fba540b39d0 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba58b04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba541e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba58b04700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba541e6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39526/0 (socket says 172.21.15.26:39526) 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.674+0000 7fba58b04700 1 -- 172.21.15.26:0/1755971762 learned_addr learned my addr 172.21.15.26:0/1755971762 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba59305700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba540b39d0 0x7fba541f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba53fff700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba541e67b0 0x7fba540b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba58b04700 1 -- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba540b39d0 msgr2=0x7fba541f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba58b04700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba540b39d0 0x7fba541f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba58b04700 1 -- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba541e67b0 msgr2=0x7fba540b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba58b04700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba541e67b0 0x7fba540b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba58b04700 1 -- 172.21.15.26:0/1755971762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54155830 con 0x7fba44005200 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba53fff700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba541e67b0 0x7fba540b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba58b04700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba541e6270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fba4800eb00 tx=0x7fba4800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48005e50 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4800c7e0 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba54154c20 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4800cb90 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.675+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba541551e0 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.676+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba541f51a0 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.677+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba4800ccf0 con 0x7fba44005200 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.677+0000 7fba517fa700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fba3806ad10 0x7fba3806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.677+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fba480892e0 con 0x7fba44005200 2023-06-09T04:39:05.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.677+0000 7fba53fff700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fba3806ad10 0x7fba3806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.678+0000 7fba53fff700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fba3806ad10 0x7fba3806d1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba40000c00 tx=0x7fba40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.682+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba48057de0 con 0x7fba44005200 2023-06-09T04:39:05.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.922+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba540d3370 con 0x7fba44005200 2023-06-09T04:39:05.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.923+0000 7fba517fa700 1 -- 172.21.15.26:0/1755971762 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fba48057970 con 0x7fba44005200 2023-06-09T04:39:05.924 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:05.925 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:05.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fba3806ad10 msgr2=0x7fba3806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fba3806ad10 0x7fba3806d1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba40000c00 tx=0x7fba40009040 comp rx=0 tx=0).stop 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 msgr2=0x7fba541e6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba541e6270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fba4800eb00 tx=0x7fba4800eec0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 shutdown_connections 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fba540b39d0 0x7fba541f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fba3806ad10 0x7fba3806d1c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba44005200 0x7fba541e6270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 --2- 172.21.15.26:0/1755971762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba541e67b0 0x7fba540b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 >> 172.21.15.26:0/1755971762 conn(0x7fba540cf560 msgr2=0x7fba541592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 shutdown_connections 2023-06-09T04:39:05.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:05.925+0000 7fba5ad68700 1 -- 172.21.15.26:0/1755971762 wait complete. 2023-06-09T04:39:05.928 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:39:05.939 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:06.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.062+0000 7fb7fc83f700 1 Processor -- start 2023-06-09T04:39:06.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.062+0000 7fb7fc83f700 1 -- start start 2023-06-09T04:39:06.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7fc83f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb7f80cd300 0x7fb7f80cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7fc83f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 0x7fb7f80ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7fc83f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f80c9d80 con 0x7fb7f80caea0 2023-06-09T04:39:06.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7fc83f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f8159630 con 0x7fb7f80cd300 2023-06-09T04:39:06.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7fc83f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80ca060 con 0x7fb7f80ca4f0 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f5d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 0x7fb7f80ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f659c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb7f80cd300 0x7fb7f80cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f5d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 0x7fb7f80ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50192/0 (socket says 172.21.15.26:50192) 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f5d9b700 1 -- 172.21.15.26:0/1857149137 learned_addr learned my addr 172.21.15.26:0/1857149137 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f659c700 1 -- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 msgr2=0x7fb7f80ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f659c700 1 --2- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 0x7fb7f80ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f659c700 1 -- 172.21.15.26:0/1857149137 >> v1:172.21.15.104:6789/0 conn(0x7fb7f80caea0 legacy=0x7fb7f806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f659c700 1 -- 172.21.15.26:0/1857149137 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80cdc10 con 0x7fb7f80cd300 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.063+0000 7fb7f5d9b700 1 --2- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 0x7fb7f80ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7f659c700 1 --2- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80cd300 0x7fb7f80cd6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009820 tx=0x7fb7e8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f856d0e93603b0de server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7f559a700 1 -- 172.21.15.26:0/1857149137 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8005e30 con 0x7fb7f80cd300 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7f559a700 1 -- 172.21.15.26:0/1857149137 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8006030 con 0x7fb7f80cd300 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7f559a700 1 -- 172.21.15.26:0/1857149137 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80063c0 con 0x7fb7f80cd300 2023-06-09T04:39:06.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 -- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80cd300 msgr2=0x7fb7f80cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80cd300 0x7fb7f80cd6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009820 tx=0x7fb7e8009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 -- 172.21.15.26:0/1857149137 shutdown_connections 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80cd300 0x7fb7f80cd6d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/1857149137 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80ca4f0 0x7fb7f80ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 -- 172.21.15.26:0/1857149137 >> 172.21.15.26:0/1857149137 conn(0x7fb7f8098b50 msgr2=0x7fb7f80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.064+0000 7fb7fc83f700 1 -- 172.21.15.26:0/1857149137 shutdown_connections 2023-06-09T04:39:06.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.065+0000 7fb7fc83f700 1 -- 172.21.15.26:0/1857149137 wait complete. 2023-06-09T04:39:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.066+0000 7fb7fc83f700 1 Processor -- start 2023-06-09T04:39:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.066+0000 7fb7fc83f700 1 -- start start 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80ca4f0 0x7fb7f81ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80caea0 0x7fb7f80c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 0x7fb7f80ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81edb20 con 0x7fb7f80cd300 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81ede00 con 0x7fb7f80ca4f0 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81ee0e0 con 0x7fb7f80caea0 2023-06-09T04:39:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 0x7fb7f80ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 0x7fb7f80ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39544/0 (socket says 172.21.15.26:39544) 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 -- 172.21.15.26:0/963443613 learned_addr learned my addr 172.21.15.26:0/963443613 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f5d9b700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80caea0 0x7fb7f80c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f659c700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80ca4f0 0x7fb7f81ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 -- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80caea0 msgr2=0x7fb7f80c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80caea0 0x7fb7f80c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 -- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80ca4f0 msgr2=0x7fb7f81ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80ca4f0 0x7fb7f81ed510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 -- 172.21.15.26:0/963443613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009550 con 0x7fb7f80cd300 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7f6d9d700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 0x7fb7f80ad7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000cc50 tx=0x7fb7f000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0003c00 con 0x7fb7f80cd300 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0003d60 con 0x7fb7f80cd300 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8009430 con 0x7fb7f80cd300 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000aab0 con 0x7fb7f80cd300 2023-06-09T04:39:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.067+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f80c4f90 con 0x7fb7f80cd300 2023-06-09T04:39:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.068+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f8067180 con 0x7fb7f80cd300 2023-06-09T04:39:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.069+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb7f000ac10 con 0x7fb7f80cd300 2023-06-09T04:39:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.069+0000 7fb7e6ffd700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb7d806ace0 0x7fb7d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.069+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb7f00893c0 con 0x7fb7f80cd300 2023-06-09T04:39:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.069+0000 7fb7f659c700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb7d806ace0 0x7fb7d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.070+0000 7fb7f659c700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb7d806ace0 0x7fb7d806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8000c00 tx=0x7fb7e8008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.074+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb7f00544c0 con 0x7fb7f80cd300 2023-06-09T04:39:06.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.274+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f80cf7c0 con 0x7fb7f80cd300 2023-06-09T04:39:06.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.276+0000 7fb7e6ffd700 1 -- 172.21.15.26:0/963443613 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fb7f0057ae0 con 0x7fb7f80cd300 2023-06-09T04:39:06.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:59.131950+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb7d806ace0 msgr2=0x7fb7d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb7d806ace0 0x7fb7d806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8000c00 tx=0x7fb7e8008070 comp rx=0 tx=0).stop 2023-06-09T04:39:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 msgr2=0x7fb7f80ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 0x7fb7f80ad7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000cc50 tx=0x7fb7f000cf60 comp rx=0 tx=0).stop 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 shutdown_connections 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb7d806ace0 0x7fb7d806d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f80cd300 0x7fb7f80ad7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7f80ca4f0 0x7fb7f81ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 --2- 172.21.15.26:0/963443613 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb7f80caea0 0x7fb7f80c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 >> 172.21.15.26:0/963443613 conn(0x7fb7f8098b50 msgr2=0x7fb7f80af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 shutdown_connections 2023-06-09T04:39:06.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.278+0000 7fb7fc83f700 1 -- 172.21.15.26:0/963443613 wait complete. 2023-06-09T04:39:06.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:08.775035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:09.876719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:39:06.292 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.418+0000 7fda9815a700 1 Processor -- start 2023-06-09T04:39:06.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.418+0000 7fda9815a700 1 -- start start 2023-06-09T04:39:06.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.419+0000 7fda9815a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fda900aed90 0x7fda900c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.419+0000 7fda9815a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda90159880 con 0x7fda900ca370 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.419+0000 7fda9815a700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9006cff0 con 0x7fda900cecb0 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.419+0000 7fda9815a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda900ca810 con 0x7fda900aed90 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.419+0000 7fda956f5700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fda900ca370 0x7fda900ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48406/0 (socket says 172.21.15.26:48406) 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.419+0000 7fda956f5700 1 -- 172.21.15.26:0/2249549252 learned_addr learned my addr 172.21.15.26:0/2249549252 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda95ef6700 1 --2- 172.21.15.26:0/2249549252 >> v2:172.21.15.104:3300/0 conn(0x7fda900aed90 0x7fda900c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988587699 0 0) 0x7fda90159880 con 0x7fda900ca370 2023-06-09T04:39:06.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda7c0035b0 con 0x7fda900ca370 2023-06-09T04:39:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304699393 0 0) 0x7fda7c0035b0 con 0x7fda900ca370 2023-06-09T04:39:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 >> v2:172.21.15.104:3300/0 conn(0x7fda900aed90 msgr2=0x7fda900c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 --2- 172.21.15.26:0/2249549252 >> v2:172.21.15.104:3300/0 conn(0x7fda900aed90 0x7fda900c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 >> v1:172.21.15.104:6789/0 conn(0x7fda900cecb0 legacy=0x7fda9006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900cf250 con 0x7fda900ca370 2023-06-09T04:39:06.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fda8c001670 con 0x7fda900ca370 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 >> v1:172.21.15.26:6789/0 conn(0x7fda900ca370 legacy=0x7fda900ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda7c003a00 0x7fda7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda7c004850 0x7fda7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c00c0e0 con 0x7fda7c005200 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c00c250 con 0x7fda7c003a00 2023-06-09T04:39:06.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c00c410 con 0x7fda7c004850 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda95ef6700 1 --2- 172.21.15.26:0/2249549252 >> v2:172.21.15.104:3300/0 conn(0x7fda900aed90 0x7fda900c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda956f5700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda7c004850 0x7fda7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda95ef6700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda7c003a00 0x7fda7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 -- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda7c004850 msgr2=0x7fda7c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda7c004850 0x7fda7c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 -- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda7c003a00 msgr2=0x7fda7c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda7c003a00 0x7fda7c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 -- 172.21.15.26:0/2249549252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0035b0 con 0x7fda7c005200 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda95ef6700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda7c003a00 0x7fda7c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.420+0000 7fda966f7700 1 -- 172.21.15.26:0/2249549252 reap_dead start 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda966f7700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda7c00ba10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c190 tx=0x7fda7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aed385c2c69fd83 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88001db0 con 0x7fda7c005200 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8800ccd0 con 0x7fda7c005200 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda94ef4700 1 -- 172.21.15.26:0/2249549252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88003c40 con 0x7fda7c005200 2023-06-09T04:39:06.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 -- 172.21.15.26:0/2249549252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 msgr2=0x7fda7c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda7c00ba10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fda8800c190 tx=0x7fda7c005880 comp rx=0 tx=0).stop 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 -- 172.21.15.26:0/2249549252 shutdown_connections 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 --2- 172.21.15.26:0/2249549252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda7c00ba10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 -- 172.21.15.26:0/2249549252 >> 172.21.15.26:0/2249549252 conn(0x7fda90098a30 msgr2=0x7fda900cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 -- 172.21.15.26:0/2249549252 shutdown_connections 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.421+0000 7fda9815a700 1 -- 172.21.15.26:0/2249549252 wait complete. 2023-06-09T04:39:06.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 Processor -- start 2023-06-09T04:39:06.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 -- start start 2023-06-09T04:39:06.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda90150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda900c7c20 0x7fda900c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda900b01a0 0x7fda900b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90151360 con 0x7fda7c005200 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c8d30 con 0x7fda900c7c20 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda9815a700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900c8120 con 0x7fda900b01a0 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda95ef6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda90150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda95ef6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda90150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39560/0 (socket says 172.21.15.26:39560) 2023-06-09T04:39:06.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.423+0000 7fda95ef6700 1 -- 172.21.15.26:0/1707255456 learned_addr learned my addr 172.21.15.26:0/1707255456 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda966f7700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda900b01a0 0x7fda900b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda956f5700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda900c7c20 0x7fda900c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda95ef6700 1 -- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda900b01a0 msgr2=0x7fda900b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda95ef6700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda900b01a0 0x7fda900b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda95ef6700 1 -- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda900c7c20 msgr2=0x7fda900c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda95ef6700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda900c7c20 0x7fda900c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda95ef6700 1 -- 172.21.15.26:0/1707255456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900c8400 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda95ef6700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda90150e20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fda80011900 tx=0x7fda80011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000f8d0 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000fa30 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900c86e0 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000fda0 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.424+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda900c9700 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.425+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda90067180 con 0x7fda7c005200 2023-06-09T04:39:06.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.426+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda80015460 con 0x7fda7c005200 2023-06-09T04:39:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.426+0000 7fda867fc700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fda7406ace0 0x7fda7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.426+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fda80089bf0 con 0x7fda7c005200 2023-06-09T04:39:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.426+0000 7fda956f5700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fda7406ace0 0x7fda7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.427+0000 7fda956f5700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fda7406ace0 0x7fda7406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda900c8050 tx=0x7fda8c001b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.431+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda80054c60 con 0x7fda7c005200 2023-06-09T04:39:06.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.626+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda900b5680 con 0x7fda7c005200 2023-06-09T04:39:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.626+0000 7fda867fc700 1 -- 172.21.15.26:0/1707255456 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda80009e60 con 0x7fda7c005200 2023-06-09T04:39:06.627 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:39:06.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fda7406ace0 msgr2=0x7fda7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fda7406ace0 0x7fda7406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda900c8050 tx=0x7fda8c001b20 comp rx=0 tx=0).stop 2023-06-09T04:39:06.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 msgr2=0x7fda90150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda90150e20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fda80011900 tx=0x7fda80011c10 comp rx=0 tx=0).stop 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 shutdown_connections 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fda900b01a0 0x7fda900b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fda7406ace0 0x7fda7406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c005200 0x7fda90150e20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 --2- 172.21.15.26:0/1707255456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda900c7c20 0x7fda900c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 >> 172.21.15.26:0/1707255456 conn(0x7fda90098a30 msgr2=0x7fda900b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 shutdown_connections 2023-06-09T04:39:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.628+0000 7fda9815a700 1 -- 172.21.15.26:0/1707255456 wait complete. 2023-06-09T04:39:06.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.767+0000 7f674ac2f700 1 Processor -- start 2023-06-09T04:39:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.767+0000 7f674ac2f700 1 -- start start 2023-06-09T04:39:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f674ac2f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f67441569b0 0x7f67440cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f674ac2f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 0x7f67440b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f674ac2f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674415d950 con 0x7f67440cf370 2023-06-09T04:39:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f674ac2f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67440d0970 con 0x7f67441569b0 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f674ac2f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440cd360 con 0x7f674415d3e0 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f6743fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f67440cf370 0x7f67440d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48426/0 (socket says 172.21.15.26:48426) 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.768+0000 7f6743fff700 1 -- 172.21.15.26:0/2246162546 learned_addr learned my addr 172.21.15.26:0/2246162546 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67489cb700 1 --2- 172.21.15.26:0/2246162546 >> v2:172.21.15.104:3300/0 conn(0x7f67441569b0 0x7f67440cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67491cc700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 0x7f67440b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416730867 0 0) 0x7f674415d950 con 0x7f67440cf370 2023-06-09T04:39:06.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67340035b0 con 0x7f67440cf370 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500876222 0 0) 0x7f67340035b0 con 0x7f67440cf370 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 msgr2=0x7f67440b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 0x7f67440b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 >> v2:172.21.15.104:3300/0 conn(0x7f67441569b0 msgr2=0x7f67440cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 --2- 172.21.15.26:0/2246162546 >> v2:172.21.15.104:3300/0 conn(0x7f67441569b0 0x7f67440cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440cd640 con 0x7f67440cf370 2023-06-09T04:39:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f6730001670 con 0x7f67440cf370 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 >> v1:172.21.15.26:6789/0 conn(0x7f67440cf370 legacy=0x7f67440d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 0x7f6734003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6734003f80 0x7f6734004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6734004d90 0x7f6734005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440d0970 con 0x7f6734004d90 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440cd360 con 0x7f6734003f80 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673400baf0 con 0x7f674415d3e0 2023-06-09T04:39:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67491cc700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6734004d90 0x7f6734005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f67489cb700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 0x7f6734003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.769+0000 7f6743fff700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6734003f80 0x7f6734004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 -- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 msgr2=0x7f6734003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f674415d3e0 0x7f6734003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 -- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6734003f80 msgr2=0x7f6734004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6734003f80 0x7f6734004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 -- 172.21.15.26:0/2246162546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340035b0 con 0x7f6734004d90 2023-06-09T04:39:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6734004d90 0x7f6734005200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f674415d880 tx=0x7f6734005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb1507a7d72c0a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c00ebd0 con 0x7f6734004d90 2023-06-09T04:39:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c00f040 con 0x7f6734004d90 2023-06-09T04:39:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67437fe700 1 -- 172.21.15.26:0/2246162546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c014480 con 0x7f6734004d90 2023-06-09T04:39:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f674ac2f700 1 -- 172.21.15.26:0/2246162546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6734004d90 msgr2=0x7f6734005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f674ac2f700 1 --2- 172.21.15.26:0/2246162546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6734004d90 0x7f6734005200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f674415d880 tx=0x7f6734005880 comp rx=0 tx=0).stop 2023-06-09T04:39:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.770+0000 7f67491cc700 1 -- 172.21.15.26:0/2246162546 reap_dead start 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.771+0000 7f674ac2f700 1 -- 172.21.15.26:0/2246162546 shutdown_connections 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.771+0000 7f674ac2f700 1 -- 172.21.15.26:0/2246162546 >> 172.21.15.26:0/2246162546 conn(0x7f674406b1f0 msgr2=0x7f674406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.771+0000 7f674ac2f700 1 -- 172.21.15.26:0/2246162546 shutdown_connections 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.771+0000 7f674ac2f700 1 -- 172.21.15.26:0/2246162546 wait complete. 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.772+0000 7f674ac2f700 1 Processor -- start 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.772+0000 7f674ac2f700 1 -- start start 2023-06-09T04:39:06.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f674ac2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 0x7f67440c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f674ac2f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67441f1840 0x7f67440c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f674ac2f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67441f1cb0 0x7f67440c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f674ac2f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440c7cc0 con 0x7f67441f1470 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f674ac2f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440c80e0 con 0x7f67441f1cb0 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f674ac2f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440c6da0 con 0x7f67441f1840 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 0x7f67440c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 0x7f67440c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39580/0 (socket says 172.21.15.26:39580) 2023-06-09T04:39:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 -- 172.21.15.26:0/3611495857 learned_addr learned my addr 172.21.15.26:0/3611495857 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67491cc700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67441f1cb0 0x7f67440c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f6743fff700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67441f1840 0x7f67440c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 -- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67441f1840 msgr2=0x7f67440c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67441f1840 0x7f67440c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 -- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67441f1cb0 msgr2=0x7f67440c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67441f1cb0 0x7f67440c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 -- 172.21.15.26:0/3611495857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440c7040 con 0x7f67441f1470 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f6743fff700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67441f1840 0x7f67440c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67489cb700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 0x7f67440c6860 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6738011aa0 tx=0x7f6738011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.773+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738005a20 con 0x7f67441f1470 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.774+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738005b80 con 0x7f67441f1470 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.774+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67440c7320 con 0x7f67441f1470 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.774+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800f9e0 con 0x7f67441f1470 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.774+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67440c78e0 con 0x7f67441f1470 2023-06-09T04:39:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.775+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6744074080 con 0x7f67441f1470 2023-06-09T04:39:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.775+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f673800fb40 con 0x7f67441f1470 2023-06-09T04:39:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.775+0000 7f67417fa700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f672806ace0 0x7f672806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.776+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6738089920 con 0x7f67441f1470 2023-06-09T04:39:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.776+0000 7f6743fff700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f672806ace0 0x7f672806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.776+0000 7f6743fff700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f672806ace0 0x7f672806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67300048d0 tx=0x7f6730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.780+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6738054a20 con 0x7f67441f1470 2023-06-09T04:39:06.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.978+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f674415dca0 con 0x7f67441f1470 2023-06-09T04:39:06.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.978+0000 7f67417fa700 1 -- 172.21.15.26:0/3611495857 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6738022020 con 0x7f67441f1470 2023-06-09T04:39:06.980 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:39:06.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f672806ace0 msgr2=0x7f672806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f672806ace0 0x7f672806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67300048d0 tx=0x7f6730009040 comp rx=0 tx=0).stop 2023-06-09T04:39:06.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 msgr2=0x7f67440c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 0x7f67440c6860 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6738011aa0 tx=0x7f6738011e60 comp rx=0 tx=0).stop 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 shutdown_connections 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67441f1cb0 0x7f67440c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f672806ace0 0x7f672806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67441f1470 0x7f67440c6860 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 --2- 172.21.15.26:0/3611495857 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f67441f1840 0x7f67440c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 >> 172.21.15.26:0/3611495857 conn(0x7f674406b1f0 msgr2=0x7f67440d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 shutdown_connections 2023-06-09T04:39:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:06.981+0000 7f674ac2f700 1 -- 172.21.15.26:0/3611495857 wait complete. 2023-06-09T04:39:06.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.122+0000 7fc62c6e7700 1 Processor -- start 2023-06-09T04:39:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.122+0000 7fc62c6e7700 1 -- start start 2023-06-09T04:39:07.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62c6e7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 0x7fc6240cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62c6e7700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc6240d1270 0x7fc6240cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62c6e7700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240cefd0 con 0x7fc6240b0240 2023-06-09T04:39:07.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62c6e7700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62415c9a0 con 0x7fc6240d1270 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62c6e7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b0740 con 0x7fc6240ce6c0 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62ac84700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc6240b0240 0x7fc6240cd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48450/0 (socket says 172.21.15.26:48450) 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62ac84700 1 -- 172.21.15.26:0/2725103032 learned_addr learned my addr 172.21.15.26:0/2725103032 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc629c82700 1 --2- 172.21.15.26:0/2725103032 >> v2:172.21.15.104:3300/0 conn(0x7fc6240d1270 0x7fc6240cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc62a483700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 0x7fc6240cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972391739 0 0) 0x7fc6240cefd0 con 0x7fc6240b0240 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6100035b0 con 0x7fc6240b0240 2023-06-09T04:39:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.123+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824506543 0 0) 0x7fc6100035b0 con 0x7fc6240b0240 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 msgr2=0x7fc6240cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 0x7fc6240cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 >> v2:172.21.15.104:3300/0 conn(0x7fc6240d1270 msgr2=0x7fc6240cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 --2- 172.21.15.26:0/2725103032 >> v2:172.21.15.104:3300/0 conn(0x7fc6240d1270 0x7fc6240cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240b0a20 con 0x7fc6240b0240 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fc61c0019f0 con 0x7fc6240b0240 2023-06-09T04:39:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 >> v1:172.21.15.26:6789/0 conn(0x7fc6240b0240 legacy=0x7fc6240cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 0x7fc610003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc610003fd0 0x7fc610004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc610004d90 0x7fc610005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62415c9a0 con 0x7fc610004d90 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b0740 con 0x7fc610003fd0 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61000ba90 con 0x7fc6240ce6c0 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629c82700 1 --2- 172.21.15.26:0/2725103032 >> v2:172.21.15.104:3300/0 conn(0x7fc6240d1270 0x7fc6240cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc610004d90 0x7fc610005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62a483700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 0x7fc610003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629c82700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc610003fd0 0x7fc610004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 -- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 msgr2=0x7fc610003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc6240ce6c0 0x7fc610003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 -- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc610003fd0 msgr2=0x7fc610004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc610003fd0 0x7fc610004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 -- 172.21.15.26:0/2725103032 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100035b0 con 0x7fc610004d90 2023-06-09T04:39:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629c82700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc610003fd0 0x7fc610004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc62ac84700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc610004d90 0x7fc610005200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00a790 tx=0x7fc610005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c3b02e15e366 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00a250 con 0x7fc610004d90 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c012600 con 0x7fc610004d90 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.124+0000 7fc629481700 1 -- 172.21.15.26:0/2725103032 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0129b0 con 0x7fc610004d90 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62c6e7700 1 -- 172.21.15.26:0/2725103032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc610004d90 msgr2=0x7fc610005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/2725103032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc610004d90 0x7fc610005200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00a790 tx=0x7fc610005880 comp rx=0 tx=0).stop 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62ac84700 1 -- 172.21.15.26:0/2725103032 reap_dead start 2023-06-09T04:39:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62c6e7700 1 -- 172.21.15.26:0/2725103032 shutdown_connections 2023-06-09T04:39:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62c6e7700 1 -- 172.21.15.26:0/2725103032 >> 172.21.15.26:0/2725103032 conn(0x7fc624089fc0 msgr2=0x7fc62408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62c6e7700 1 -- 172.21.15.26:0/2725103032 shutdown_connections 2023-06-09T04:39:07.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.125+0000 7fc62c6e7700 1 -- 172.21.15.26:0/2725103032 wait complete. 2023-06-09T04:39:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.127+0000 7fc62c6e7700 1 Processor -- start 2023-06-09T04:39:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.127+0000 7fc62c6e7700 1 -- start start 2023-06-09T04:39:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62c6e7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc610004d90 0x7fc624146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62c6e7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc62415cb50 0x7fc62415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62c6e7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 0x7fc624149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62c6e7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c58a0 con 0x7fc6241492e0 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62c6e7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624149ca0 con 0x7fc62415cb50 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62c6e7700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c5500 con 0x7fc610004d90 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 0x7fc624149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 0x7fc624149760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39604/0 (socket says 172.21.15.26:39604) 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 -- 172.21.15.26:0/375685329 learned_addr learned my addr 172.21.15.26:0/375685329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc629c82700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc62415cb50 0x7fc62415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62a483700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc610004d90 0x7fc624146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 -- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc610004d90 msgr2=0x7fc624146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc610004d90 0x7fc624146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 -- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc62415cb50 msgr2=0x7fc62415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc62415cb50 0x7fc62415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 -- 172.21.15.26:0/375685329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62415f6f0 con 0x7fc6241492e0 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc62ac84700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 0x7fc624149760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00a760 tx=0x7fc61c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.128+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00a250 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.129+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c0019c0 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.129+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c026640 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.129+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62415f9d0 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.129+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc624146e40 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.129+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6240b1d20 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.130+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc61c019030 con 0x7fc6241492e0 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.130+0000 7fc61affd700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc60806ace0 0x7fc60806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.130+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc61c08adc0 con 0x7fc6241492e0 2023-06-09T04:39:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.131+0000 7fc62a483700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc60806ace0 0x7fc60806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.131+0000 7fc62a483700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc60806ace0 0x7fc60806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc620009ba0 tx=0x7fc620008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.135+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc61c055e40 con 0x7fc6241492e0 2023-06-09T04:39:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.336+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc624072020 con 0x7fc6241492e0 2023-06-09T04:39:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.336+0000 7fc61affd700 1 -- 172.21.15.26:0/375685329 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc61c059460 con 0x7fc6241492e0 2023-06-09T04:39:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-06-09T04:39:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc60806ace0 msgr2=0x7fc60806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc60806ace0 0x7fc60806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc620009ba0 tx=0x7fc620008040 comp rx=0 tx=0).stop 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 msgr2=0x7fc624149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 0x7fc624149760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00a760 tx=0x7fc61c001cb0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 shutdown_connections 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc60806ace0 0x7fc60806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6241492e0 0x7fc624149760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc610004d90 0x7fc624146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 --2- 172.21.15.26:0/375685329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc62415cb50 0x7fc62415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 >> 172.21.15.26:0/375685329 conn(0x7fc624089fc0 msgr2=0x7fc6240d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 shutdown_connections 2023-06-09T04:39:07.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.338+0000 7fc62c6e7700 1 -- 172.21.15.26:0/375685329 wait complete. 2023-06-09T04:39:07.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.477+0000 7f125777d700 1 Processor -- start 2023-06-09T04:39:07.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.477+0000 7f125777d700 1 -- start start 2023-06-09T04:39:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f125777d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12500d1270 0x7f12500caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f125777d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 0x7f12500cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f125777d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500b0740 con 0x7f12500ce6c0 2023-06-09T04:39:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f125777d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125015c9a0 con 0x7f12500d1270 2023-06-09T04:39:07.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f125777d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12500b0a20 con 0x7f12500b0240 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f1254d18700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12500d1270 0x7f12500caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f1255d1a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 0x7f12500cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f1255d1a700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 0x7f12500cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50270/0 (socket says 172.21.15.26:50270) 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.478+0000 7f1255d1a700 1 -- 172.21.15.26:0/299792508 learned_addr learned my addr 172.21.15.26:0/299792508 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1255d1a700 1 -- 172.21.15.26:0/299792508 >> v2:172.21.15.104:3300/0 conn(0x7f12500d1270 msgr2=0x7f12500caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1255d1a700 1 --2- 172.21.15.26:0/299792508 >> v2:172.21.15.104:3300/0 conn(0x7f12500d1270 0x7f12500caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1255d1a700 1 -- 172.21.15.26:0/299792508 >> v1:172.21.15.104:6789/0 conn(0x7f12500ce6c0 legacy=0x7f12500cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1255d1a700 1 -- 172.21.15.26:0/299792508 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500b0d00 con 0x7f12500b0240 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1255d1a700 1 --2- 172.21.15.26:0/299792508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 0x7f12500cb470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1248009e50 tx=0x7f124800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f661f64d5f1f3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1247fff700 1 -- 172.21.15.26:0/299792508 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800e070 con 0x7f12500b0240 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1247fff700 1 -- 172.21.15.26:0/299792508 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124800b910 con 0x7f12500b0240 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f1247fff700 1 -- 172.21.15.26:0/299792508 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800bcc0 con 0x7f12500b0240 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f125777d700 1 -- 172.21.15.26:0/299792508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 msgr2=0x7f12500cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.479+0000 7f125777d700 1 --2- 172.21.15.26:0/299792508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 0x7f12500cb470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1248009e50 tx=0x7f124800b330 comp rx=0 tx=0).stop 2023-06-09T04:39:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.480+0000 7f125777d700 1 -- 172.21.15.26:0/299792508 shutdown_connections 2023-06-09T04:39:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.480+0000 7f125777d700 1 --2- 172.21.15.26:0/299792508 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500b0240 0x7f12500cb470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.480+0000 7f125777d700 1 --2- 172.21.15.26:0/299792508 >> v2:172.21.15.104:3300/0 conn(0x7f12500d1270 0x7f12500caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.480+0000 7f125777d700 1 -- 172.21.15.26:0/299792508 >> 172.21.15.26:0/299792508 conn(0x7f1250089fc0 msgr2=0x7f125008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.480+0000 7f125777d700 1 -- 172.21.15.26:0/299792508 shutdown_connections 2023-06-09T04:39:07.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.480+0000 7f125777d700 1 -- 172.21.15.26:0/299792508 wait complete. 2023-06-09T04:39:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.481+0000 7f125777d700 1 Processor -- start 2023-06-09T04:39:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.481+0000 7f125777d700 1 -- start start 2023-06-09T04:39:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12500b0240 0x7f12501591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500ce6c0 0x7f125015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 0x7f1250152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125015df40 con 0x7f12500d1270 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125015d020 con 0x7f12500b0240 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125015d2c0 con 0x7f12500ce6c0 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 0x7f1250152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 0x7f1250152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39618/0 (socket says 172.21.15.26:39618) 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 -- 172.21.15.26:0/2764538453 learned_addr learned my addr 172.21.15.26:0/2764538453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1254d18700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500ce6c0 0x7f125015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255519700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12500b0240 0x7f12501591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 -- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500ce6c0 msgr2=0x7f125015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500ce6c0 0x7f125015cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 -- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12500b0240 msgr2=0x7f12501591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12500b0240 0x7f12501591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 -- 172.21.15.26:0/2764538453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009b30 con 0x7f12500d1270 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255519700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12500b0240 0x7f12501591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:07.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1254d18700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500ce6c0 0x7f125015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1255d1a700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 0x7f1250152da0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f12500b0b60 tx=0x7f1248004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248004960 con 0x7f12500d1270 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12480099b0 con 0x7f12500d1270 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124801b670 con 0x7f12500d1270 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.482+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125015d5a0 con 0x7f12500d1270 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.483+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125015db60 con 0x7f12500d1270 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.484+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1250070250 con 0x7f12500d1270 2023-06-09T04:39:07.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.484+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f124801b7d0 con 0x7f12500d1270 2023-06-09T04:39:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.485+0000 7f1245ffb700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f123406ace0 0x7f123406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.485+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f124808ae70 con 0x7f12500d1270 2023-06-09T04:39:07.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.485+0000 7f1255519700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f123406ace0 0x7f123406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.485+0000 7f1255519700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f123406ace0 0x7f123406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f124c000f60 tx=0x7f124c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.489+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1248055ed0 con 0x7f12500d1270 2023-06-09T04:39:07.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.685+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12500b1d20 con 0x7f12500d1270 2023-06-09T04:39:07.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.686+0000 7f1245ffb700 1 -- 172.21.15.26:0/2764538453 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12480594f0 con 0x7f12500d1270 2023-06-09T04:39:07.687 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-06-09T04:39:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f123406ace0 msgr2=0x7f123406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f123406ace0 0x7f123406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f124c000f60 tx=0x7f124c009040 comp rx=0 tx=0).stop 2023-06-09T04:39:07.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 msgr2=0x7f1250152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 0x7f1250152da0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f12500b0b60 tx=0x7f1248004ad0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 shutdown_connections 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f123406ace0 0x7f123406d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12500d1270 0x7f1250152da0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12500b0240 0x7f12501591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 --2- 172.21.15.26:0/2764538453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12500ce6c0 0x7f125015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 >> 172.21.15.26:0/2764538453 conn(0x7f1250089fc0 msgr2=0x7f125015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 shutdown_connections 2023-06-09T04:39:07.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.688+0000 7f125777d700 1 -- 172.21.15.26:0/2764538453 wait complete. 2023-06-09T04:39:07.701 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.824+0000 7fb30733d700 1 Processor -- start 2023-06-09T04:39:07.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.824+0000 7fb30733d700 1 -- start start 2023-06-09T04:39:07.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb30733d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 0x7fb300160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb30733d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000cce70 con 0x7fb30015c550 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb30733d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb300160790 con 0x7fb3000cc620 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb30733d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb300161030 con 0x7fb3000d0e50 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb3050d9700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb30015c550 0x7fb3000caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48480/0 (socket says 172.21.15.26:48480) 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb3050d9700 1 -- 172.21.15.26:0/1957480266 learned_addr learned my addr 172.21.15.26:0/1957480266 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb3058da700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 0x7fb300160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675286524 0 0) 0x7fb3000cce70 con 0x7fb30015c550 2023-06-09T04:39:07.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec0035b0 con 0x7fb30015c550 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616218709 0 0) 0x7fb2ec0035b0 con 0x7fb30015c550 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 msgr2=0x7fb300160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 0x7fb300160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 >> v1:172.21.15.104:6789/0 conn(0x7fb3000cc620 legacy=0x7fb3000d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300160a70 con 0x7fb30015c550 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.825+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fb2fc0017f0 con 0x7fb30015c550 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 >> v1:172.21.15.26:6789/0 conn(0x7fb30015c550 legacy=0x7fb3000caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 0x7fb2ec003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ec003f70 0x7fb2ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2ec004d90 0x7fb2ec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb300161030 con 0x7fb2ec004d90 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec00bba0 con 0x7fb2ec003f70 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec00bd60 con 0x7fb3000d0e50 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2ec004d90 0x7fb2ec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3050d9700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 0x7fb2ec003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3048d8700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ec003f70 0x7fb2ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 -- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 msgr2=0x7fb2ec003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000d0e50 0x7fb2ec003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 -- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ec003f70 msgr2=0x7fb2ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ec003f70 0x7fb2ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 -- 172.21.15.26:0/1957480266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0035b0 con 0x7fb2ec004d90 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb3058da700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2ec004d90 0x7fb2ec005200 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009fc0 tx=0x7fb2ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633af270591b1267 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800ec30 con 0x7fb2ec004d90 2023-06-09T04:39:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800f040 con 0x7fb2ec004d90 2023-06-09T04:39:07.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.826+0000 7fb2f7fff700 1 -- 172.21.15.26:0/1957480266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8014480 con 0x7fb2ec004d90 2023-06-09T04:39:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb30733d700 1 -- 172.21.15.26:0/1957480266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2ec004d90 msgr2=0x7fb2ec005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb30733d700 1 --2- 172.21.15.26:0/1957480266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2ec004d90 0x7fb2ec005200 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009fc0 tx=0x7fb2ec005880 comp rx=0 tx=0).stop 2023-06-09T04:39:07.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb3058da700 1 -- 172.21.15.26:0/1957480266 reap_dead start 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb30733d700 1 -- 172.21.15.26:0/1957480266 shutdown_connections 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb30733d700 1 -- 172.21.15.26:0/1957480266 >> 172.21.15.26:0/1957480266 conn(0x7fb300089fc0 msgr2=0x7fb30008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb30733d700 1 -- 172.21.15.26:0/1957480266 shutdown_connections 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.827+0000 7fb30733d700 1 -- 172.21.15.26:0/1957480266 wait complete. 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.828+0000 7fb30733d700 1 Processor -- start 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.828+0000 7fb30733d700 1 -- start start 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb30733d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 0x7fb3001f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb30733d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000c4410 0x7fb3000ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb30733d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3000adc50 0x7fb3000b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb30733d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c4880 con 0x7fb3001f1830 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb30733d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001f2e80 con 0x7fb3000adc50 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb30733d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001f2270 con 0x7fb3000c4410 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 0x7fb3001f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 0x7fb3001f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39634/0 (socket says 172.21.15.26:39634) 2023-06-09T04:39:07.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 -- 172.21.15.26:0/3371847199 learned_addr learned my addr 172.21.15.26:0/3371847199 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3058da700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3000adc50 0x7fb3000b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3048d8700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000c4410 0x7fb3000ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 -- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000c4410 msgr2=0x7fb3000ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000c4410 0x7fb3000ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 -- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3000adc50 msgr2=0x7fb3000b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3000adc50 0x7fb3000b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 -- 172.21.15.26:0/3371847199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3001f2550 con 0x7fb3001f1830 2023-06-09T04:39:07.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3058da700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3000adc50 0x7fb3000b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.829+0000 7fb3050d9700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 0x7fb3001f1c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005c20 tx=0x7fb2fc008060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.830+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc008790 con 0x7fb3001f1830 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.830+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc003d70 con 0x7fb3001f1830 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.830+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc004120 con 0x7fb3001f1830 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.830+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3001f2830 con 0x7fb3001f1830 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.830+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000b6170 con 0x7fb3001f1830 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.831+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3000b0380 con 0x7fb3001f1830 2023-06-09T04:39:07.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.831+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2fc004280 con 0x7fb3001f1830 2023-06-09T04:39:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.831+0000 7fb2f5ffb700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb2e406ace0 0x7fb2e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.831+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb2fc089660 con 0x7fb3001f1830 2023-06-09T04:39:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.832+0000 7fb3048d8700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb2e406ace0 0x7fb2e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.832+0000 7fb3048d8700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb2e406ace0 0x7fb2e406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb3001f6560 tx=0x7fb2f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:07.836+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2fc054760 con 0x7fb3001f1830 2023-06-09T04:39:08.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.079+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3000b1db0 con 0x7fb3001f1830 2023-06-09T04:39:08.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.080+0000 7fb2f5ffb700 1 -- 172.21.15.26:0/3371847199 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fb2fc057d80 con 0x7fb3001f1830 2023-06-09T04:39:08.081 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:08.081 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb2e406ace0 msgr2=0x7fb2e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb2e406ace0 0x7fb2e406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb3001f6560 tx=0x7fb2f0009040 comp rx=0 tx=0).stop 2023-06-09T04:39:08.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 msgr2=0x7fb3001f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 0x7fb3001f1c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005c20 tx=0x7fb2fc008060 comp rx=0 tx=0).stop 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 shutdown_connections 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3000adc50 0x7fb3000b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fb2e406ace0 0x7fb2e406d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3001f1830 0x7fb3001f1c00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 --2- 172.21.15.26:0/3371847199 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3000c4410 0x7fb3000ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 >> 172.21.15.26:0/3371847199 conn(0x7fb300089fc0 msgr2=0x7fb3000d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 shutdown_connections 2023-06-09T04:39:08.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.082+0000 7fb30733d700 1 -- 172.21.15.26:0/3371847199 wait complete. 2023-06-09T04:39:08.085 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:39:08.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:08.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.220+0000 7f30cb6f5700 1 Processor -- start 2023-06-09T04:39:08.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.221+0000 7f30cb6f5700 1 -- start start 2023-06-09T04:39:08.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.221+0000 7f30cb6f5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f30c415c6e0 0x7f30c40ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.221+0000 7f30cb6f5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 0x7f30c40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.221+0000 7f30cb6f5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c406f190 con 0x7f30c406e990 2023-06-09T04:39:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.221+0000 7f30cb6f5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c406e440 con 0x7f30c415c6e0 2023-06-09T04:39:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.221+0000 7f30cb6f5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c406e690 con 0x7f30c4098e30 2023-06-09T04:39:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c8c90700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f30c406e990 0x7f30c40cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48500/0 (socket says 172.21.15.26:48500) 2023-06-09T04:39:08.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c8c90700 1 -- 172.21.15.26:0/1626418540 learned_addr learned my addr 172.21.15.26:0/1626418540 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c9491700 1 --2- 172.21.15.26:0/1626418540 >> v2:172.21.15.104:3300/0 conn(0x7f30c415c6e0 0x7f30c40ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c9c92700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 0x7f30c40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105585151 0 0) 0x7f30c406f190 con 0x7f30c406e990 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b00035b0 con 0x7f30c406e990 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3765736852 0 0) 0x7f30b00035b0 con 0x7f30c406e990 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 msgr2=0x7f30c40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 0x7f30c40aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 >> v2:172.21.15.104:3300/0 conn(0x7f30c415c6e0 msgr2=0x7f30c40ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 --2- 172.21.15.26:0/1626418540 >> v2:172.21.15.104:3300/0 conn(0x7f30c415c6e0 0x7f30c40ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4160300 con 0x7f30c406e990 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f30b8001670 con 0x7f30c406e990 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 >> v1:172.21.15.26:6789/0 conn(0x7f30c406e990 legacy=0x7f30c40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 0x7f30b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30b0003f80 0x7f30b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b0004d90 0x7f30b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c406e440 con 0x7f30b0004d90 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c406e690 con 0x7f30b0003f80 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b000ba40 con 0x7f30c4098e30 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c9c92700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b0004d90 0x7f30b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c9491700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 0x7f30b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.222+0000 7f30c8c90700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30b0003f80 0x7f30b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 -- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 msgr2=0x7f30b0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c4098e30 0x7f30b0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 -- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30b0003f80 msgr2=0x7f30b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30b0003f80 0x7f30b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 -- 172.21.15.26:0/1626418540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00035b0 con 0x7f30b0004d90 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b0004d90 0x7f30b0005200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009fc0 tx=0x7f30b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9068c8ebdd1d37e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00ebd0 con 0x7f30b0004d90 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc00f040 con 0x7f30b0004d90 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30b7fff700 1 -- 172.21.15.26:0/1626418540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc014480 con 0x7f30b0004d90 2023-06-09T04:39:08.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30cb6f5700 1 -- 172.21.15.26:0/1626418540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b0004d90 msgr2=0x7f30b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/1626418540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30b0004d90 0x7f30b0005200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009fc0 tx=0x7f30b0005880 comp rx=0 tx=0).stop 2023-06-09T04:39:08.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.223+0000 7f30c9c92700 1 -- 172.21.15.26:0/1626418540 reap_dead start 2023-06-09T04:39:08.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.224+0000 7f30cb6f5700 1 -- 172.21.15.26:0/1626418540 shutdown_connections 2023-06-09T04:39:08.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.224+0000 7f30cb6f5700 1 -- 172.21.15.26:0/1626418540 >> 172.21.15.26:0/1626418540 conn(0x7f30c4098a30 msgr2=0x7f30c40cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.224+0000 7f30cb6f5700 1 -- 172.21.15.26:0/1626418540 shutdown_connections 2023-06-09T04:39:08.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.224+0000 7f30cb6f5700 1 -- 172.21.15.26:0/1626418540 wait complete. 2023-06-09T04:39:08.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.225+0000 7f30cb6f5700 1 Processor -- start 2023-06-09T04:39:08.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.225+0000 7f30cb6f5700 1 -- start start 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30c415b730 0x7f30c40c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c415bb00 0x7f30c40c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 0x7f30c4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40cca90 con 0x7f30c4159b00 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40c86b0 con 0x7f30c415b730 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40c8990 con 0x7f30c415bb00 2023-06-09T04:39:08.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 0x7f30c4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 0x7f30c4159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39658/0 (socket says 172.21.15.26:39658) 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 -- 172.21.15.26:0/2973453793 learned_addr learned my addr 172.21.15.26:0/2973453793 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9491700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30c415b730 0x7f30c40c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c8c90700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c415bb00 0x7f30c40c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 -- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c415bb00 msgr2=0x7f30c40c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c415bb00 0x7f30c40c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 -- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30c415b730 msgr2=0x7f30c40c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30c415b730 0x7f30c40c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 -- 172.21.15.26:0/2973453793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40c8c70 con 0x7f30c4159b00 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30c9c92700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 0x7f30c4159f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00b010 tx=0x7f30bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc007000 con 0x7f30c4159b00 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc004450 con 0x7f30c4159b00 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40c8f50 con 0x7f30c4159b00 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.226+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc004800 con 0x7f30c4159b00 2023-06-09T04:39:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.227+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c40c8310 con 0x7f30c4159b00 2023-06-09T04:39:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.228+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c4067180 con 0x7f30c4159b00 2023-06-09T04:39:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.228+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30bc023070 con 0x7f30c4159b00 2023-06-09T04:39:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.228+0000 7f30b5ffb700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f30a806ad10 0x7f30a806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.228+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f30bc08a030 con 0x7f30c4159b00 2023-06-09T04:39:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.229+0000 7f30c9491700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f30a806ad10 0x7f30a806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.229+0000 7f30c9491700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f30a806ad10 0x7f30a806d1c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009cc0 tx=0x7f30c00091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.233+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30bc055310 con 0x7f30c4159b00 2023-06-09T04:39:08.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.432+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30c40ce6f0 con 0x7f30c4159b00 2023-06-09T04:39:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.433+0000 7f30b5ffb700 1 -- 172.21.15.26:0/2973453793 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f30bc058930 con 0x7f30c4159b00 2023-06-09T04:39:08.435 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:08.435 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:59.131950+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.435+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f30a806ad10 msgr2=0x7f30a806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.435+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f30a806ad10 0x7f30a806d1c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009cc0 tx=0x7f30c00091c0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.435+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 msgr2=0x7f30c4159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.435+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 0x7f30c4159f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00b010 tx=0x7f30bc009750 comp rx=0 tx=0).stop 2023-06-09T04:39:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.435+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 shutdown_connections 2023-06-09T04:39:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.435+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f30a806ad10 0x7f30a806d1c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.436+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30c4159b00 0x7f30c4159f70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.436+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30c415b730 0x7f30c40c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.436+0000 7f30cb6f5700 1 --2- 172.21.15.26:0/2973453793 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f30c415bb00 0x7f30c40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.436+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 >> 172.21.15.26:0/2973453793 conn(0x7f30c4098a30 msgr2=0x7f30c4069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.436+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 shutdown_connections 2023-06-09T04:39:08.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.436+0000 7f30cb6f5700 1 -- 172.21.15.26:0/2973453793 wait complete. 2023-06-09T04:39:08.449 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T04:39:08.449 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.573+0000 7f7ad9a14700 1 Processor -- start 2023-06-09T04:39:08.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.573+0000 7f7ad9a14700 1 -- start start 2023-06-09T04:39:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.573+0000 7f7ad9a14700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad415a340 0x7f7ad40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.573+0000 7f7ad9a14700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40d08b0 con 0x7f7ad40b0850 2023-06-09T04:39:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.573+0000 7f7ad9a14700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40b0d20 con 0x7f7ad40ce4b0 2023-06-09T04:39:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.573+0000 7f7ad9a14700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad415a710 con 0x7f7ad415a340 2023-06-09T04:39:08.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad415a340 0x7f7ad40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad37fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7ad40b0850 0x7f7ad40ad470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48524/0 (socket says 172.21.15.26:48524) 2023-06-09T04:39:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad37fe700 1 -- 172.21.15.26:0/1257587181 learned_addr learned my addr 172.21.15.26:0/1257587181 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1257587181 >> v1:172.21.15.104:6789/0 conn(0x7f7ad40ce4b0 legacy=0x7f7ad40b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1257587181 >> v1:172.21.15.26:6789/0 conn(0x7f7ad40b0850 legacy=0x7f7ad40ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1257587181 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40b1000 con 0x7f7ad415a340 2023-06-09T04:39:08.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1257587181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad415a340 0x7f7ad40b1dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009820 tx=0x7f7ac4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995b5cfb14ffba67 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad1ffb700 1 -- 172.21.15.26:0/1257587181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4005e30 con 0x7f7ad415a340 2023-06-09T04:39:08.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad1ffb700 1 -- 172.21.15.26:0/1257587181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac4006030 con 0x7f7ad415a340 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.574+0000 7f7ad1ffb700 1 -- 172.21.15.26:0/1257587181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40063e0 con 0x7f7ad415a340 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1257587181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad415a340 msgr2=0x7f7ad40b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1257587181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad415a340 0x7f7ad40b1dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009820 tx=0x7f7ac4009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1257587181 shutdown_connections 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1257587181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad415a340 0x7f7ad40b1dc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1257587181 >> 172.21.15.26:0/1257587181 conn(0x7f7ad4089fc0 msgr2=0x7f7ad408a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1257587181 shutdown_connections 2023-06-09T04:39:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.575+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1257587181 wait complete. 2023-06-09T04:39:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.576+0000 7f7ad9a14700 1 Processor -- start 2023-06-09T04:39:08.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.576+0000 7f7ad9a14700 1 -- start start 2023-06-09T04:39:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad9a14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 0x7f7ad41f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad9a14700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40ce4b0 0x7f7ad415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad9a14700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ad415a340 0x7f7ad4155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad9a14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415d110 con 0x7f7ad40b0850 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad9a14700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41f24f0 con 0x7f7ad40ce4b0 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad9a14700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41f27d0 con 0x7f7ad415a340 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 0x7f7ad41f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 0x7f7ad41f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39668/0 (socket says 172.21.15.26:39668) 2023-06-09T04:39:08.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1207941167 learned_addr learned my addr 172.21.15.26:0/1207941167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad37fe700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ad415a340 0x7f7ad4155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad27fc700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40ce4b0 0x7f7ad415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ad415a340 msgr2=0x7f7ad4155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ad415a340 0x7f7ad4155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40ce4b0 msgr2=0x7f7ad415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40ce4b0 0x7f7ad415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad2ffd700 1 -- 172.21.15.26:0/1207941167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009430 con 0x7f7ad40b0850 2023-06-09T04:39:08.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.577+0000 7f7ad37fe700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ad415a340 0x7f7ad4155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.578+0000 7f7ad2ffd700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 0x7f7ad41f1ec0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4000c00 tx=0x7f7ac4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.578+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4004240 con 0x7f7ad40b0850 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.578+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40043e0 con 0x7f7ad40b0850 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.578+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40036a0 con 0x7f7ad40b0850 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.578+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad41f2ab0 con 0x7f7ad40b0850 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.578+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad406b0c0 con 0x7f7ad40b0850 2023-06-09T04:39:08.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.579+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad41570a0 con 0x7f7ad40b0850 2023-06-09T04:39:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.579+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ac4022070 con 0x7f7ad40b0850 2023-06-09T04:39:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.580+0000 7f7abbfff700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.580+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ac408af00 con 0x7f7ad40b0850 2023-06-09T04:39:08.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.580+0000 7f7ad27fc700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.580+0000 7f7ad27fc700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7ac006ace0 0x7f7ac006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40b5f00 tx=0x7f7ac8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.584+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ac4055f60 con 0x7f7ad40b0850 2023-06-09T04:39:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.825+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ad40d1380 con 0x7f7ad40b0850 2023-06-09T04:39:08.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.825+0000 7f7abbfff700 1 -- 172.21.15.26:0/1207941167 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f7ac402a090 con 0x7f7ad40b0850 2023-06-09T04:39:08.827 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:08.827 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7ac006ace0 msgr2=0x7f7ac006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7ac006ace0 0x7f7ac006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40b5f00 tx=0x7f7ac8009040 comp rx=0 tx=0).stop 2023-06-09T04:39:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 msgr2=0x7f7ad41f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 0x7f7ad41f1ec0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4000c00 tx=0x7f7ac4004750 comp rx=0 tx=0).stop 2023-06-09T04:39:08.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 shutdown_connections 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ad415a340 0x7f7ad4155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40b0850 0x7f7ad41f1ec0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 --2- 172.21.15.26:0/1207941167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40ce4b0 0x7f7ad415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 >> 172.21.15.26:0/1207941167 conn(0x7f7ad4089fc0 msgr2=0x7f7ad41578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 shutdown_connections 2023-06-09T04:39:08.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.828+0000 7f7ad9a14700 1 -- 172.21.15.26:0/1207941167 wait complete. 2023-06-09T04:39:08.831 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:39:08.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:08.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.965+0000 7f5f50819700 1 Processor -- start 2023-06-09T04:39:08.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.965+0000 7f5f50819700 1 -- start start 2023-06-09T04:39:08.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f50819700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5f4c15c6e0 0x7f5f4c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f50819700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 0x7f5f4c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f50819700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c06f190 con 0x7f5f4c06e990 2023-06-09T04:39:08.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f50819700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c06e440 con 0x7f5f4c15c6e0 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f50819700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c06e690 con 0x7f5f4c098e30 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f49d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5f4c06e990 0x7f5f4c0cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48534/0 (socket says 172.21.15.26:48534) 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f49d9b700 1 -- 172.21.15.26:0/2950859897 learned_addr learned my addr 172.21.15.26:0/2950859897 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4a59c700 1 --2- 172.21.15.26:0/2950859897 >> v2:172.21.15.104:3300/0 conn(0x7f5f4c15c6e0 0x7f5f4c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 0x7f5f4c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591611359 0 0) 0x7f5f4c06f190 con 0x7f5f4c06e990 2023-06-09T04:39:08.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f340035b0 con 0x7f5f4c06e990 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032795162 0 0) 0x7f5f340035b0 con 0x7f5f4c06e990 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 msgr2=0x7f5f4c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 0x7f5f4c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 >> v2:172.21.15.104:3300/0 conn(0x7f5f4c15c6e0 msgr2=0x7f5f4c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 --2- 172.21.15.26:0/2950859897 >> v2:172.21.15.104:3300/0 conn(0x7f5f4c15c6e0 0x7f5f4c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c160300 con 0x7f5f4c06e990 2023-06-09T04:39:08.971 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f5f40001670 con 0x7f5f4c06e990 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.966+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 >> v1:172.21.15.26:6789/0 conn(0x7f5f4c06e990 legacy=0x7f5f4c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 0x7f5f34003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f34003f80 0x7f5f34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f34004d90 0x7f5f34005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c06e440 con 0x7f5f34004d90 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c06e690 con 0x7f5f34003f80 2023-06-09T04:39:08.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3400ba40 con 0x7f5f4c098e30 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f34004d90 0x7f5f34005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4a59c700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 0x7f5f34003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f49d9b700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f34003f80 0x7f5f34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 msgr2=0x7f5f34003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f4c098e30 0x7f5f34003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f34003f80 msgr2=0x7f5f34004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f34003f80 0x7f5f34004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/2950859897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340035b0 con 0x7f5f34004d90 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f34004d90 0x7f5f34005200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009fc0 tx=0x7f5f34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74229042c1d1bbbd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400ebd0 con 0x7f5f34004d90 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400f040 con 0x7f5f34004d90 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.967+0000 7f5f4959a700 1 -- 172.21.15.26:0/2950859897 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44014480 con 0x7f5f34004d90 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f50819700 1 -- 172.21.15.26:0/2950859897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f34004d90 msgr2=0x7f5f34005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f50819700 1 --2- 172.21.15.26:0/2950859897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f34004d90 0x7f5f34005200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009fc0 tx=0x7f5f34005880 comp rx=0 tx=0).stop 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/2950859897 reap_dead start 2023-06-09T04:39:08.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f50819700 1 -- 172.21.15.26:0/2950859897 shutdown_connections 2023-06-09T04:39:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f50819700 1 -- 172.21.15.26:0/2950859897 >> 172.21.15.26:0/2950859897 conn(0x7f5f4c098a30 msgr2=0x7f5f4c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f50819700 1 -- 172.21.15.26:0/2950859897 shutdown_connections 2023-06-09T04:39:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.968+0000 7f5f50819700 1 -- 172.21.15.26:0/2950859897 wait complete. 2023-06-09T04:39:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.969+0000 7f5f50819700 1 Processor -- start 2023-06-09T04:39:08.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.969+0000 7f5f50819700 1 -- start start 2023-06-09T04:39:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f50819700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f34004d90 0x7f5f4c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f50819700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f4c158a00 0x7f5f4c06a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f50819700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 0x7f5f4c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f50819700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c157e30 con 0x7f5f4c14d730 2023-06-09T04:39:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f50819700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c14e0e0 con 0x7f5f4c158a00 2023-06-09T04:39:08.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f50819700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c158fc0 con 0x7f5f34004d90 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f4ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 0x7f5f4c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f4ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 0x7f5f4c14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39692/0 (socket says 172.21.15.26:39692) 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/4267857121 learned_addr learned my addr 172.21.15.26:0/4267857121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f4a59c700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f34004d90 0x7f5f4c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.970+0000 7f5f49d9b700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f4c158a00 0x7f5f4c06a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f34004d90 msgr2=0x7f5f4c0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f34004d90 0x7f5f4c0c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f4c158a00 msgr2=0x7f5f4c06a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f4c158a00 0x7f5f4c06a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f4ad9d700 1 -- 172.21.15.26:0/4267857121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c1592a0 con 0x7f5f4c14d730 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f4ad9d700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 0x7f5f4c14dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f44017040 tx=0x7f5f44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44007000 con 0x7f5f4c14d730 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44003e50 con 0x7f5f4c14d730 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c159580 con 0x7f5f4c14d730 2023-06-09T04:39:08.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44014b50 con 0x7f5f4c14d730 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.971+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c159b40 con 0x7f5f4c14d730 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.972+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c067180 con 0x7f5f4c14d730 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.972+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f44023020 con 0x7f5f4c14d730 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.973+0000 7f5f3affd700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f2c06ad10 0x7f5f2c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.973+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5f4408a830 con 0x7f5f4c14d730 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.973+0000 7f5f4a59c700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f2c06ad10 0x7f5f2c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.973+0000 7f5f4a59c700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f2c06ad10 0x7f5f2c06d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009b00 tx=0x7f5f3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:08.977+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f440559e0 con 0x7f5f4c14d730 2023-06-09T04:39:09.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.220+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f4c0ce6f0 con 0x7f5f4c14d730 2023-06-09T04:39:09.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.220+0000 7f5f3affd700 1 -- 172.21.15.26:0/4267857121 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f5f44014cb0 con 0x7f5f4c14d730 2023-06-09T04:39:09.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:09.221 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/113972897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":113972897},{"type":"v1","addr":"172.21.15.26:6835","nonce":113972897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1163432537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1163432537},{"type":"v1","addr":"172.21.15.26:6834","nonce":1163432537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/504954683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":504954683},{"type":"v1","addr":"172.21.15.104:6835","nonce":504954683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:10.903661+0000","modified":"2023-06-09T04:38:13.919504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2737305300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":2737305300},{"type":"v1","addr":"172.21.15.104:6837","nonce":2737305300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f2c06ad10 msgr2=0x7f5f2c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f2c06ad10 0x7f5f2c06d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009b00 tx=0x7f5f3c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 msgr2=0x7f5f4c14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 0x7f5f4c14dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f44017040 tx=0x7f5f44009750 comp rx=0 tx=0).stop 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 shutdown_connections 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5f2c06ad10 0x7f5f2c06d1c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f4c14d730 0x7f5f4c14dba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5f34004d90 0x7f5f4c0c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 --2- 172.21.15.26:0/4267857121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f4c158a00 0x7f5f4c06a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 >> 172.21.15.26:0/4267857121 conn(0x7f5f4c098a30 msgr2=0x7f5f4c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 shutdown_connections 2023-06-09T04:39:09.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.222+0000 7f5f50819700 1 -- 172.21.15.26:0/4267857121 wait complete. 2023-06-09T04:39:09.225 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-06-09T04:39:09.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.359+0000 7fa0fdd3d700 1 Processor -- start 2023-06-09T04:39:09.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.359+0000 7fa0fdd3d700 1 -- start start 2023-06-09T04:39:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0fdd3d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0f80aed50 0x7fa0f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0fdd3d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0fdd3d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f806f190 con 0x7fa0f815c6e0 2023-06-09T04:39:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0fdd3d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f806e440 con 0x7fa0f80aed50 2023-06-09T04:39:09.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0fdd3d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f806e690 con 0x7fa0f806e990 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0f6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0f80aed50 0x7fa0f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0f6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa0f80aed50 0x7fa0f8069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39698/0 (socket says 172.21.15.26:39698) 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.360+0000 7fa0f6ffd700 1 -- 172.21.15.26:0/3025865937 learned_addr learned my addr 172.21.15.26:0/3025865937 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f7fff700 1 --2- 172.21.15.26:0/3025865937 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f6ffd700 1 -- 172.21.15.26:0/3025865937 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 msgr2=0x7fa0f806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f6ffd700 1 --2- 172.21.15.26:0/3025865937 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f6ffd700 1 -- 172.21.15.26:0/3025865937 >> v1:172.21.15.104:6789/0 conn(0x7fa0f815c6e0 legacy=0x7fa0f80ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f6ffd700 1 -- 172.21.15.26:0/3025865937 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8160300 con 0x7fa0f80aed50 2023-06-09T04:39:09.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f6ffd700 1 --2- 172.21.15.26:0/3025865937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80aed50 0x7fa0f8069db0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0098f0 tx=0x7fa0ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e308ea2fb06dbb3f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f67fc700 1 -- 172.21.15.26:0/3025865937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec004230 con 0x7fa0f80aed50 2023-06-09T04:39:09.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f67fc700 1 -- 172.21.15.26:0/3025865937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec004390 con 0x7fa0f80aed50 2023-06-09T04:39:09.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0f67fc700 1 -- 172.21.15.26:0/3025865937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0036a0 con 0x7fa0f80aed50 2023-06-09T04:39:09.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/3025865937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80aed50 msgr2=0x7fa0f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/3025865937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80aed50 0x7fa0f8069db0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0098f0 tx=0x7fa0ec009c00 comp rx=0 tx=0).stop 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/3025865937 shutdown_connections 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/3025865937 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/3025865937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f80aed50 0x7fa0f8069db0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.361+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/3025865937 >> 172.21.15.26:0/3025865937 conn(0x7fa0f8098a30 msgr2=0x7fa0f80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.362+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/3025865937 shutdown_connections 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.362+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/3025865937 wait complete. 2023-06-09T04:39:09.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.363+0000 7fa0fdd3d700 1 Processor -- start 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.363+0000 7fa0fdd3d700 1 -- start start 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f8154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f80aed50 0x7fa0f80c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 0x7fa0f80c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c95a0 con 0x7fa0f815c6e0 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c8fc0 con 0x7fa0f80aed50 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c4260 con 0x7fa0f806e990 2023-06-09T04:39:09.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 0x7fa0f80c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 0x7fa0f80c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39706/0 (socket says 172.21.15.26:39706) 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 -- 172.21.15.26:0/1096932664 learned_addr learned my addr 172.21.15.26:0/1096932664 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f77fe700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f8154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f6ffd700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f80aed50 0x7fa0f80c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 -- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 msgr2=0x7fa0f8154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f8154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 -- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f80aed50 msgr2=0x7fa0f80c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f80aed50 0x7fa0f80c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 -- 172.21.15.26:0/1096932664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009550 con 0x7fa0f815c6e0 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0f7fff700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 0x7fa0f80c73e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000ccb0 tx=0x7fa0f0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0003a20 con 0x7fa0f815c6e0 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0003b80 con 0x7fa0f815c6e0 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80c9230 con 0x7fa0f815c6e0 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000aa10 con 0x7fa0f815c6e0 2023-06-09T04:39:09.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.364+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80c3ea0 con 0x7fa0f815c6e0 2023-06-09T04:39:09.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.365+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f80c8e20 con 0x7fa0f815c6e0 2023-06-09T04:39:09.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.366+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0f000ab70 con 0x7fa0f815c6e0 2023-06-09T04:39:09.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.366+0000 7fa0dffff700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa0e406ace0 0x7fa0e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.366+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa0f0089510 con 0x7fa0f815c6e0 2023-06-09T04:39:09.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.366+0000 7fa0f77fe700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa0e406ace0 0x7fa0e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.367+0000 7fa0f77fe700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa0e406ace0 0x7fa0e406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80050c0 tx=0x7fa0e8007f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.371+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0f80c8e20 con 0x7fa0f815c6e0 2023-06-09T04:39:09.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.567+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f80c96e0 con 0x7fa0f815c6e0 2023-06-09T04:39:09.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.568+0000 7fa0dffff700 1 -- 172.21.15.26:0/1096932664 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fa0f80c96e0 con 0x7fa0f815c6e0 2023-06-09T04:39:09.570 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:09.570 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:38:59.131950+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:08.775035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:09.876719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa0e406ace0 msgr2=0x7fa0e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa0e406ace0 0x7fa0e406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80050c0 tx=0x7fa0e8007f10 comp rx=0 tx=0).stop 2023-06-09T04:39:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 msgr2=0x7fa0f80c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 0x7fa0f80c73e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000ccb0 tx=0x7fa0f0007f70 comp rx=0 tx=0).stop 2023-06-09T04:39:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 shutdown_connections 2023-06-09T04:39:09.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa0e406ace0 0x7fa0e406d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0f815c6e0 0x7fa0f80c73e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa0f806e990 0x7fa0f8154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.570+0000 7fa0fdd3d700 1 --2- 172.21.15.26:0/1096932664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0f80aed50 0x7fa0f80c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.571+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 >> 172.21.15.26:0/1096932664 conn(0x7fa0f8098a30 msgr2=0x7fa0f80cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.571+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 shutdown_connections 2023-06-09T04:39:09.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.571+0000 7fa0fdd3d700 1 -- 172.21.15.26:0/1096932664 wait complete. 2023-06-09T04:39:09.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T04:39:09.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.708+0000 7ff0e2c2f700 1 Processor -- start 2023-06-09T04:39:09.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.708+0000 7ff0e2c2f700 1 -- start start 2023-06-09T04:39:09.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0e2c2f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff0dc15c620 0x7ff0dc0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0e2c2f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0dc0aeb20 0x7ff0dc06e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0e2c2f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0b2130 con 0x7ff0dc06e8c0 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0e2c2f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc0aef90 con 0x7ff0dc0aeb20 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0e2c2f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc06a9c0 con 0x7ff0dc15c620 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0dc0aeb20 0x7ff0dc06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0dc0aeb20 0x7ff0dc06e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39712/0 (socket says 172.21.15.26:39712) 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 -- 172.21.15.26:0/4031782143 learned_addr learned my addr 172.21.15.26:0/4031782143 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:09.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0e09cb700 1 --2- 172.21.15.26:0/4031782143 >> v2:172.21.15.104:3300/0 conn(0x7ff0dc15c620 0x7ff0dc0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 -- 172.21.15.26:0/4031782143 >> v2:172.21.15.104:3300/0 conn(0x7ff0dc15c620 msgr2=0x7ff0dc0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 --2- 172.21.15.26:0/4031782143 >> v2:172.21.15.104:3300/0 conn(0x7ff0dc15c620 0x7ff0dc0ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 -- 172.21.15.26:0/4031782143 >> v1:172.21.15.104:6789/0 conn(0x7ff0dc06e8c0 legacy=0x7ff0dc06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.709+0000 7ff0dbfff700 1 -- 172.21.15.26:0/4031782143 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0ac3b0 con 0x7ff0dc0aeb20 2023-06-09T04:39:09.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0dbfff700 1 --2- 172.21.15.26:0/4031782143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc06e380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc071130 tx=0x7ff0c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8832bb5f54c95a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0db7fe700 1 -- 172.21.15.26:0/4031782143 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8004230 con 0x7ff0dc0aeb20 2023-06-09T04:39:09.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0db7fe700 1 -- 172.21.15.26:0/4031782143 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8004390 con 0x7ff0dc0aeb20 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0db7fe700 1 -- 172.21.15.26:0/4031782143 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80036a0 con 0x7ff0dc0aeb20 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/4031782143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0aeb20 msgr2=0x7ff0dc06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/4031782143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc06e380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc071130 tx=0x7ff0c8009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/4031782143 shutdown_connections 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/4031782143 >> v2:172.21.15.104:3300/0 conn(0x7ff0dc15c620 0x7ff0dc0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/4031782143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc06e380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/4031782143 >> 172.21.15.26:0/4031782143 conn(0x7ff0dc098b50 msgr2=0x7ff0dc0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/4031782143 shutdown_connections 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.710+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/4031782143 wait complete. 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 Processor -- start 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 -- start start 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0dc06e8c0 0x7ff0dc0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 0x7ff0dc0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b5700 con 0x7ff0dc15c620 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc1f5180 con 0x7ff0dc0aeb20 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.712+0000 7ff0e2c2f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc1f5460 con 0x7ff0dc06e8c0 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 0x7ff0dc0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 0x7ff0dc0cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39720/0 (socket says 172.21.15.26:39720) 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 -- 172.21.15.26:0/2441375272 learned_addr learned my addr 172.21.15.26:0/2441375272 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0dbfff700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e09cb700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0dc06e8c0 0x7ff0dc0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 -- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0dc06e8c0 msgr2=0x7ff0dc0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0dc06e8c0 0x7ff0dc0c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 -- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0dc0aeb20 msgr2=0x7ff0dc0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc0b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 -- 172.21.15.26:0/2441375272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009550 con 0x7ff0dc15c620 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0dbfff700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e09cb700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0dc06e8c0 0x7ff0dc0c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:09.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e11cc700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 0x7ff0dc0cf7c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400b970 tx=0x7ff0d400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400c9b0 con 0x7ff0dc15c620 2023-06-09T04:39:09.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400cb10 con 0x7ff0dc15c620 2023-06-09T04:39:09.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc1f5740 con 0x7ff0dc15c620 2023-06-09T04:39:09.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4014440 con 0x7ff0dc15c620 2023-06-09T04:39:09.719 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.713+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0c9290 con 0x7ff0dc15c620 2023-06-09T04:39:09.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.714+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc1f5c60 con 0x7ff0dc15c620 2023-06-09T04:39:09.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.715+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0d401d3b0 con 0x7ff0dc15c620 2023-06-09T04:39:09.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.715+0000 7ff0d97fa700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff0c006ace0 0x7ff0c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.715+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff0d4089090 con 0x7ff0dc15c620 2023-06-09T04:39:09.720 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.715+0000 7ff0e09cb700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff0c006ace0 0x7ff0c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.716+0000 7ff0e09cb700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff0c006ace0 0x7ff0c006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0b15b0 tx=0x7ff0d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.719+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0dc1f5c60 con 0x7ff0dc15c620 2023-06-09T04:39:09.962 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:09.961+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff0dc1f5c60 con 0x7ff0dc15c620 2023-06-09T04:39:10.167 INFO:tasks.ceph.mon.a.smithi026.stderr:2023-06-09T04:39:10.167+0000 7f3591b0e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T04:39:10.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.177+0000 7ff0d97fa700 1 -- 172.21.15.26:0/2441375272 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff0dc1f5c60 con 0x7ff0dc15c620 2023-06-09T04:39:10.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.179+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff0c006ace0 msgr2=0x7ff0c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.179+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff0c006ace0 0x7ff0c006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0b15b0 tx=0x7ff0d0008040 comp rx=0 tx=0).stop 2023-06-09T04:39:10.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.179+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 msgr2=0x7ff0dc0cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.179+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 0x7ff0dc0cf7c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400b970 tx=0x7ff0d400bd30 comp rx=0 tx=0).stop 2023-06-09T04:39:10.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 shutdown_connections 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff0c006ace0 0x7ff0c006d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0dc15c620 0x7ff0dc0cf7c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0dc06e8c0 0x7ff0dc0c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 --2- 172.21.15.26:0/2441375272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0dc0aeb20 0x7ff0dc0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 >> 172.21.15.26:0/2441375272 conn(0x7ff0dc098b50 msgr2=0x7ff0dc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 shutdown_connections 2023-06-09T04:39:10.182 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.180+0000 7ff0e2c2f700 1 -- 172.21.15.26:0/2441375272 wait complete. 2023-06-09T04:39:10.183 INFO:tasks.ceph.mds.d.smithi104.stderr: -3159> 2023-06-09T04:38:16.539+0000 7f8192f98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:39:10.183 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T04:39:10.193 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T04:39:10.211 INFO:tasks.ceph.mds.d.smithi104.stdout:starting mds.d at 2023-06-09T04:39:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.321+0000 7fc22d3be700 1 Processor -- start 2023-06-09T04:39:10.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.321+0000 7fc22d3be700 1 -- start start 2023-06-09T04:39:10.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc22d3be700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc22815d3e0 0x7fc2280d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc22d3be700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22815d950 con 0x7fc2281569b0 2023-06-09T04:39:10.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc22d3be700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2280cd360 con 0x7fc2280d1300 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc22d3be700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280d0970 con 0x7fc22815d3e0 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc2267fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc22815d3e0 0x7fc2280d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc226ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc2281569b0 0x7fc2280cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48582/0 (socket says 172.21.15.26:48582) 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc226ffd700 1 -- 172.21.15.26:0/3391394744 learned_addr learned my addr 172.21.15.26:0/3391394744 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc2267fc700 1 -- 172.21.15.26:0/3391394744 >> v1:172.21.15.104:6789/0 conn(0x7fc2280d1300 legacy=0x7fc2280b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc2267fc700 1 -- 172.21.15.26:0/3391394744 >> v1:172.21.15.26:6789/0 conn(0x7fc2281569b0 legacy=0x7fc2280cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc2267fc700 1 -- 172.21.15.26:0/3391394744 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280cd640 con 0x7fc22815d3e0 2023-06-09T04:39:10.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc225ffb700 1 -- 172.21.15.26:0/3391394744 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923559799 0 0) 0x7fc22815d950 con 0x7fc2281569b0 2023-06-09T04:39:10.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc2267fc700 1 --2- 172.21.15.26:0/3391394744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2280d0dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc218009840 tx=0x7fc218009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7356f03fd413f10e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.322+0000 7fc225ffb700 1 -- 172.21.15.26:0/3391394744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218004230 con 0x7fc22815d3e0 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc225ffb700 1 -- 172.21.15.26:0/3391394744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218004390 con 0x7fc22815d3e0 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc225ffb700 1 -- 172.21.15.26:0/3391394744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180036a0 con 0x7fc22815d3e0 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 -- 172.21.15.26:0/3391394744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 msgr2=0x7fc2280d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 --2- 172.21.15.26:0/3391394744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2280d0dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc218009840 tx=0x7fc218009b50 comp rx=0 tx=0).stop 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 -- 172.21.15.26:0/3391394744 shutdown_connections 2023-06-09T04:39:10.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 --2- 172.21.15.26:0/3391394744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2280d0dc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 -- 172.21.15.26:0/3391394744 >> 172.21.15.26:0/3391394744 conn(0x7fc22806b1f0 msgr2=0x7fc22806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 -- 172.21.15.26:0/3391394744 shutdown_connections 2023-06-09T04:39:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.323+0000 7fc22d3be700 1 -- 172.21.15.26:0/3391394744 wait complete. 2023-06-09T04:39:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.324+0000 7fc22d3be700 1 Processor -- start 2023-06-09T04:39:10.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.324+0000 7fc22d3be700 1 -- start start 2023-06-09T04:39:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc22d3be700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2280d1300 0x7fc2280c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc22d3be700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2281569b0 0x7fc2280c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc22d3be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2281e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc22d3be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c8f20 con 0x7fc22815d3e0 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc22d3be700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22814f580 con 0x7fc2281569b0 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc22d3be700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c8c40 con 0x7fc2280d1300 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc2277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2281e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc2277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2281e69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39734/0 (socket says 172.21.15.26:39734) 2023-06-09T04:39:10.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc2277fe700 1 -- 172.21.15.26:0/2021694743 learned_addr learned my addr 172.21.15.26:0/2021694743 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc226ffd700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2280d1300 0x7fc2280c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.325+0000 7fc2267fc700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2281569b0 0x7fc2280c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc2277fe700 1 -- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2280d1300 msgr2=0x7fc2280c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc2277fe700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2280d1300 0x7fc2280c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc2277fe700 1 -- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2281569b0 msgr2=0x7fc2280c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc2277fe700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2281569b0 0x7fc2280c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc2277fe700 1 -- 172.21.15.26:0/2021694743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180094a0 con 0x7fc22815d3e0 2023-06-09T04:39:10.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc2277fe700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2281e69f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc22000b990 tx=0x7fc22000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000d890 con 0x7fc22815d3e0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000d9f0 con 0x7fc22815d3e0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2281e5f10 con 0x7fc22815d3e0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000dda0 con 0x7fc22815d3e0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.326+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2281e64d0 con 0x7fc22815d3e0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.327+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2281e5d70 con 0x7fc22815d3e0 2023-06-09T04:39:10.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.327+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc220006d50 con 0x7fc22815d3e0 2023-06-09T04:39:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.328+0000 7fc20f7fe700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc21406ace0 0x7fc21406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.328+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fc220089420 con 0x7fc22815d3e0 2023-06-09T04:39:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.328+0000 7fc226ffd700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc21406ace0 0x7fc21406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.328+0000 7fc226ffd700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc21406ace0 0x7fc21406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc21c007fd0 tx=0x7fc21c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.332+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2281e5d70 con 0x7fc22815d3e0 2023-06-09T04:39:10.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:10.575+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc2281e5d70 con 0x7fc22815d3e0 2023-06-09T04:39:11.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.185+0000 7fc20f7fe700 1 -- 172.21.15.26:0/2021694743 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc2281e5d70 con 0x7fc22815d3e0 2023-06-09T04:39:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc21406ace0 msgr2=0x7fc21406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc21406ace0 0x7fc21406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc21c007fd0 tx=0x7fc21c009040 comp rx=0 tx=0).stop 2023-06-09T04:39:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 msgr2=0x7fc2281e69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2281e69f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc22000b990 tx=0x7fc22000bca0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 shutdown_connections 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc21406ace0 0x7fc21406d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc22815d3e0 0x7fc2281e69f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2280d1300 0x7fc2280c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 --2- 172.21.15.26:0/2021694743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2281569b0 0x7fc2280c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 >> 172.21.15.26:0/2021694743 conn(0x7fc22806b1f0 msgr2=0x7fc2280b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 shutdown_connections 2023-06-09T04:39:11.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.188+0000 7fc22d3be700 1 -- 172.21.15.26:0/2021694743 wait complete. 2023-06-09T04:39:11.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T04:39:11.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.338+0000 7fcf50e07700 1 Processor -- start 2023-06-09T04:39:11.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.339+0000 7fcf50e07700 1 -- start start 2023-06-09T04:39:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.339+0000 7fcf50e07700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf4c0b11f0 0x7fcf4c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.339+0000 7fcf50e07700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf4c06aec0 0x7fcf4c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.339+0000 7fcf50e07700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c06b860 con 0x7fcf4c15c450 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.339+0000 7fcf50e07700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0ce3f0 con 0x7fcf4c0b11f0 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.339+0000 7fcf50e07700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0cef30 con 0x7fcf4c06aec0 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf4c0b11f0 0x7fcf4c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcf4c0b11f0 0x7fcf4c0b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39738/0 (socket says 172.21.15.26:39738) 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 -- 172.21.15.26:0/974632056 learned_addr learned my addr 172.21.15.26:0/974632056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf4ad9d700 1 --2- 172.21.15.26:0/974632056 >> v2:172.21.15.104:3300/0 conn(0x7fcf4c06aec0 0x7fcf4c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 -- 172.21.15.26:0/974632056 >> v2:172.21.15.104:3300/0 conn(0x7fcf4c06aec0 msgr2=0x7fcf4c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:11.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 --2- 172.21.15.26:0/974632056 >> v2:172.21.15.104:3300/0 conn(0x7fcf4c06aec0 0x7fcf4c06b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 -- 172.21.15.26:0/974632056 >> v1:172.21.15.104:6789/0 conn(0x7fcf4c15c450 legacy=0x7fcf4c0ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 -- 172.21.15.26:0/974632056 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0b16f0 con 0x7fcf4c0b11f0 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf4ad9d700 1 --2- 172.21.15.26:0/974632056 >> v2:172.21.15.104:3300/0 conn(0x7fcf4c06aec0 0x7fcf4c06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf49d9b700 1 --2- 172.21.15.26:0/974632056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0b0210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06d850 tx=0x7fcf40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0c304aae3fd845 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf4959a700 1 -- 172.21.15.26:0/974632056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40004230 con 0x7fcf4c0b11f0 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf4959a700 1 -- 172.21.15.26:0/974632056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40004390 con 0x7fcf4c0b11f0 2023-06-09T04:39:11.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.340+0000 7fcf4959a700 1 -- 172.21.15.26:0/974632056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400036a0 con 0x7fcf4c0b11f0 2023-06-09T04:39:11.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 -- 172.21.15.26:0/974632056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c0b11f0 msgr2=0x7fcf4c0b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 --2- 172.21.15.26:0/974632056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0b0210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06d850 tx=0x7fcf40009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 -- 172.21.15.26:0/974632056 shutdown_connections 2023-06-09T04:39:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 --2- 172.21.15.26:0/974632056 >> v2:172.21.15.104:3300/0 conn(0x7fcf4c06aec0 0x7fcf4c06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 --2- 172.21.15.26:0/974632056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0b0210 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 -- 172.21.15.26:0/974632056 >> 172.21.15.26:0/974632056 conn(0x7fcf4c06a6d0 msgr2=0x7fcf4c099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 -- 172.21.15.26:0/974632056 shutdown_connections 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.341+0000 7fcf50e07700 1 -- 172.21.15.26:0/974632056 wait complete. 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.342+0000 7fcf50e07700 1 Processor -- start 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.342+0000 7fcf50e07700 1 -- start start 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf50e07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 0x7fcf4c154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf50e07700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf50e07700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf4c15c450 0x7fcf4c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf50e07700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0cdb00 con 0x7fcf4c06aec0 2023-06-09T04:39:11.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf50e07700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b40f0 con 0x7fcf4c0b11f0 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf50e07700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0cbba0 con 0x7fcf4c15c450 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 0x7fcf4c154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 0x7fcf4c154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39744/0 (socket says 172.21.15.26:39744) 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 -- 172.21.15.26:0/395731898 learned_addr learned my addr 172.21.15.26:0/395731898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf49d9b700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4ad9d700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf4c15c450 0x7fcf4c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 -- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf4c15c450 msgr2=0x7fcf4c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf4c15c450 0x7fcf4c0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 -- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf4c0b11f0 msgr2=0x7fcf4c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.343+0000 7fcf4a59c700 1 -- 172.21.15.26:0/395731898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40009550 con 0x7fcf4c06aec0 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.344+0000 7fcf4a59c700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 0x7fcf4c154010 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b450 tx=0x7fcf3c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.344+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00be60 con 0x7fcf4c06aec0 2023-06-09T04:39:11.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.344+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c004020 con 0x7fcf4c06aec0 2023-06-09T04:39:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.344+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0cc670 con 0x7fcf4c06aec0 2023-06-09T04:39:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.344+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0043d0 con 0x7fcf4c06aec0 2023-06-09T04:39:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.344+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c0cc0b0 con 0x7fcf4c06aec0 2023-06-09T04:39:11.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.345+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c067180 con 0x7fcf4c06aec0 2023-06-09T04:39:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.345+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf3c0036d0 con 0x7fcf4c06aec0 2023-06-09T04:39:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.346+0000 7fcf3affd700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf2c06ace0 0x7fcf2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.346+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fcf3c088bf0 con 0x7fcf4c06aec0 2023-06-09T04:39:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.346+0000 7fcf49d9b700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf2c06ace0 0x7fcf2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.346+0000 7fcf49d9b700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf2c06ace0 0x7fcf2c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009130 tx=0x7fcf40008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.350+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf3c053c10 con 0x7fcf4c06aec0 2023-06-09T04:39:11.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:11.547+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf4c0b03b0 con 0x7fcf4c06aec0 2023-06-09T04:39:12.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.195+0000 7fcf3affd700 1 -- 172.21.15.26:0/395731898 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcf3c0150d0 con 0x7fcf4c06aec0 2023-06-09T04:39:12.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf2c06ace0 msgr2=0x7fcf2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf2c06ace0 0x7fcf2c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009130 tx=0x7fcf40008030 comp rx=0 tx=0).stop 2023-06-09T04:39:12.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 msgr2=0x7fcf4c154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 0x7fcf4c154010 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b450 tx=0x7fcf3c00b760 comp rx=0 tx=0).stop 2023-06-09T04:39:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 shutdown_connections 2023-06-09T04:39:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcf4c15c450 0x7fcf4c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcf2c06ace0 0x7fcf2c06d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf4c06aec0 0x7fcf4c154010 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 --2- 172.21.15.26:0/395731898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf4c0b11f0 0x7fcf4c0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 >> 172.21.15.26:0/395731898 conn(0x7fcf4c06a6d0 msgr2=0x7fcf4c0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 shutdown_connections 2023-06-09T04:39:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.199+0000 7fcf50e07700 1 -- 172.21.15.26:0/395731898 wait complete. 2023-06-09T04:39:12.202 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-06-09T04:39:12.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T04:39:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.351+0000 7f298ef94700 1 Processor -- start 2023-06-09T04:39:12.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.351+0000 7f298ef94700 1 -- start start 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298ef94700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2988069db0 0x7f298806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298ef94700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f298815b3d0 0x7f298806db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298ef94700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298806e080 0x7f29880b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298ef94700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298815a590 con 0x7f298815b3d0 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298ef94700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29880c9cd0 con 0x7f2988069db0 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298ef94700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298806a6c0 con 0x7f298806e080 2023-06-09T04:39:12.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f298815b3d0 0x7f298806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f298815b3d0 0x7f298806db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39752/0 (socket says 172.21.15.26:39752) 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 -- 172.21.15.26:0/1017112240 learned_addr learned my addr 172.21.15.26:0/1017112240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298d531700 1 --2- 172.21.15.26:0/1017112240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298806e080 0x7f29880b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f298cd30700 1 --2- 172.21.15.26:0/1017112240 >> v2:172.21.15.104:3300/0 conn(0x7f2988069db0 0x7f298806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 -- 172.21.15.26:0/1017112240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298806e080 msgr2=0x7f29880b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 --2- 172.21.15.26:0/1017112240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298806e080 0x7f29880b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 -- 172.21.15.26:0/1017112240 >> v2:172.21.15.104:3300/0 conn(0x7f2988069db0 msgr2=0x7f298806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 --2- 172.21.15.26:0/1017112240 >> v2:172.21.15.104:3300/0 conn(0x7f2988069db0 0x7f298806a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.352+0000 7f2987fff700 1 -- 172.21.15.26:0/1017112240 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298806e5e0 con 0x7f298815b3d0 2023-06-09T04:39:12.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f2987fff700 1 --2- 172.21.15.26:0/1017112240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298815b3d0 0x7f298806db40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2988071130 tx=0x7f2974009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fff7bd39c37ba2b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f29877fe700 1 -- 172.21.15.26:0/1017112240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974011830 con 0x7f298815b3d0 2023-06-09T04:39:12.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f29877fe700 1 -- 172.21.15.26:0/1017112240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974011990 con 0x7f298815b3d0 2023-06-09T04:39:12.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f29877fe700 1 -- 172.21.15.26:0/1017112240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974011d20 con 0x7f298815b3d0 2023-06-09T04:39:12.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 -- 172.21.15.26:0/1017112240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298815b3d0 msgr2=0x7f298806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 --2- 172.21.15.26:0/1017112240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298815b3d0 0x7f298806db40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2988071130 tx=0x7f2974009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 -- 172.21.15.26:0/1017112240 shutdown_connections 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 --2- 172.21.15.26:0/1017112240 >> v2:172.21.15.104:3300/0 conn(0x7f2988069db0 0x7f298806a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 --2- 172.21.15.26:0/1017112240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298806e080 0x7f29880b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 --2- 172.21.15.26:0/1017112240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298815b3d0 0x7f298806db40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 -- 172.21.15.26:0/1017112240 >> 172.21.15.26:0/1017112240 conn(0x7f298806b7e0 msgr2=0x7f29880cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 -- 172.21.15.26:0/1017112240 shutdown_connections 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.353+0000 7f298ef94700 1 -- 172.21.15.26:0/1017112240 wait complete. 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 Processor -- start 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 -- start start 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988069db0 0x7f29880cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 0x7f2988158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298815b3d0 0x7f29880ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880ce130 con 0x7f298806e080 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880b0a10 con 0x7f2988069db0 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.355+0000 7f298ef94700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29880b0cf0 con 0x7f298815b3d0 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 0x7f2988158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 0x7f2988158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39760/0 (socket says 172.21.15.26:39760) 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 -- 172.21.15.26:0/649616640 learned_addr learned my addr 172.21.15.26:0/649616640 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 -- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298815b3d0 msgr2=0x7f29880ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f298d531700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298815b3d0 0x7f29880ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f298cd30700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988069db0 0x7f29880cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298815b3d0 0x7f29880ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 -- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988069db0 msgr2=0x7f29880cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988069db0 0x7f29880cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 -- 172.21.15.26:0/649616640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974009550 con 0x7f298806e080 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f2987fff700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 0x7f2988158350 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f2974004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974004300 con 0x7f298806e080 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297401f070 con 0x7f298806e080 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29880b0fd0 con 0x7f298806e080 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29740036a0 con 0x7f298806e080 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.356+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29880cd410 con 0x7f298806e080 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.357+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29880b14f0 con 0x7f298806e080 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.358+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2974021030 con 0x7f298806e080 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.358+0000 7f29857fa700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f296c06ace0 0x7f296c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.358+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f297408a510 con 0x7f298806e080 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.359+0000 7f298cd30700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f296c06ace0 0x7f296c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.359+0000 7f298cd30700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f296c06ace0 0x7f296c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f297c009a90 tx=0x7f297c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.363+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29880b14f0 con 0x7f298806e080 2023-06-09T04:39:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:12.563+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f29880b14f0 con 0x7f298806e080 2023-06-09T04:39:13.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.198+0000 7f29857fa700 1 -- 172.21.15.26:0/649616640 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f29880b14f0 con 0x7f298806e080 2023-06-09T04:39:13.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f296c06ace0 msgr2=0x7f296c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f296c06ace0 0x7f296c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f297c009a90 tx=0x7f297c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:13.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 msgr2=0x7f2988158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 0x7f2988158350 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f2974004750 comp rx=0 tx=0).stop 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 shutdown_connections 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f298815b3d0 0x7f29880ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2988069db0 0x7f29880cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f296c06ace0 0x7f296c06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 --2- 172.21.15.26:0/649616640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f298806e080 0x7f2988158350 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 >> 172.21.15.26:0/649616640 conn(0x7f298806b7e0 msgr2=0x7f29880b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.203+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 shutdown_connections 2023-06-09T04:39:13.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.204+0000 7f298ef94700 1 -- 172.21.15.26:0/649616640 wait complete. 2023-06-09T04:39:13.206 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-06-09T04:39:13.220 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:39:13.221 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-09T04:39:13.221 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T04:39:13.221 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:13.221 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:39:13.221 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-09T04:39:13.222 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T04:39:13.222 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:13.222 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:39:13.222 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-09T04:39:13.223 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T04:39:13.223 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:13.223 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:39:13.223 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-09T04:39:13.223 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T04:39:13.224 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:13.231 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T04:39:13.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:39:13.232 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T04:39:13.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:39:13.233 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T04:39:13.233 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:39:13.234 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T04:39:13.234 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:39:13.273 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:39:13.273 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:13.274 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:39:13.274 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:13.276 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:39:13.276 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:13.276 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:39:13.277 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:13.277 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-09T04:39:13.360 INFO:tasks.ceph.mds.b.smithi104.stdout:starting mds.b at 2023-06-09T04:39:13.360 INFO:tasks.ceph.mds.d.smithi104.stdout:starting mds.d at 2023-06-09T04:39:13.362 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-06-09T04:39:13.363 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-06-09T04:39:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.423+0000 7f91fd562700 1 Processor -- start 2023-06-09T04:39:13.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.423+0000 7f91fd562700 1 -- start start 2023-06-09T04:39:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91fd562700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91f80ccc90 0x7f91f80ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91fd562700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80cc0f0 con 0x7f91f80caf70 2023-06-09T04:39:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91fd562700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80cb4e0 con 0x7f91f815d780 2023-06-09T04:39:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91fd562700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f80b00a0 con 0x7f91f80ccc90 2023-06-09T04:39:13.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f67fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f91f80caf70 0x7f91f80cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48652/0 (socket says 172.21.15.26:48652) 2023-06-09T04:39:13.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f67fc700 1 -- 172.21.15.26:0/2085724425 learned_addr learned my addr 172.21.15.26:0/2085724425 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:13.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f77fe700 1 --2- 172.21.15.26:0/2085724425 >> v2:172.21.15.104:3300/0 conn(0x7f91f80ccc90 0x7f91f80ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f5ffb700 1 -- 172.21.15.26:0/2085724425 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504003851 0 0) 0x7f91f80cc0f0 con 0x7f91f80caf70 2023-06-09T04:39:13.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f5ffb700 1 -- 172.21.15.26:0/2085724425 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e00035b0 con 0x7f91f80caf70 2023-06-09T04:39:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f77fe700 1 -- 172.21.15.26:0/2085724425 >> v1:172.21.15.104:6789/0 conn(0x7f91f815d780 legacy=0x7f91f80b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f77fe700 1 -- 172.21.15.26:0/2085724425 >> v1:172.21.15.26:6789/0 conn(0x7f91f80caf70 legacy=0x7f91f80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f5ffb700 1 -- 172.21.15.26:0/2085724425 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623536663 0 0) 0x7f91e00035b0 con 0x7f91f80caf70 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.424+0000 7f91f77fe700 1 -- 172.21.15.26:0/2085724425 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80cb7c0 con 0x7f91f80ccc90 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91f77fe700 1 --2- 172.21.15.26:0/2085724425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80ccc90 0x7f91f80ce4f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009d90 tx=0x7f91f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c16e3d475344973 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91f5ffb700 1 -- 172.21.15.26:0/2085724425 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f000e070 con 0x7f91f80ccc90 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91f5ffb700 1 -- 172.21.15.26:0/2085724425 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0003a20 con 0x7f91f80ccc90 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91f5ffb700 1 -- 172.21.15.26:0/2085724425 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec001670 con 0x7f91f80ccc90 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 -- 172.21.15.26:0/2085724425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80ccc90 msgr2=0x7f91f80ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 --2- 172.21.15.26:0/2085724425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80ccc90 0x7f91f80ce4f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009d90 tx=0x7f91f000b330 comp rx=0 tx=0).stop 2023-06-09T04:39:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 -- 172.21.15.26:0/2085724425 shutdown_connections 2023-06-09T04:39:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 --2- 172.21.15.26:0/2085724425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80ccc90 0x7f91f80ce4f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 -- 172.21.15.26:0/2085724425 >> 172.21.15.26:0/2085724425 conn(0x7f91f8089fc0 msgr2=0x7f91f80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 -- 172.21.15.26:0/2085724425 shutdown_connections 2023-06-09T04:39:13.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.425+0000 7f91fd562700 1 -- 172.21.15.26:0/2085724425 wait complete. 2023-06-09T04:39:13.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 Processor -- start 2023-06-09T04:39:13.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 -- start start 2023-06-09T04:39:13.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80caf70 0x7f91f806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 0x7f91f80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91f815d780 0x7f91f8150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80c6950 con 0x7f91f80ccc90 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81f3c60 con 0x7f91f80caf70 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91fd562700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81f3f40 con 0x7f91f815d780 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.427+0000 7f91f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 0x7f91f80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 0x7f91f80c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39798/0 (socket says 172.21.15.26:39798) 2023-06-09T04:39:13.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 -- 172.21.15.26:0/3497270509 learned_addr learned my addr 172.21.15.26:0/3497270509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f6ffd700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80caf70 0x7f91f806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f77fe700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91f815d780 0x7f91f8150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 -- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91f815d780 msgr2=0x7f91f8150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91f815d780 0x7f91f8150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 -- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80caf70 msgr2=0x7f91f806f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80caf70 0x7f91f806f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 -- 172.21.15.26:0/3497270509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0009a70 con 0x7f91f80ccc90 2023-06-09T04:39:13.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f6ffd700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80caf70 0x7f91f806f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91f67fc700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 0x7f91f80c9000 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0011e0 tx=0x7f91ec00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec004c80 con 0x7f91f80ccc90 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec004de0 con 0x7f91f80ccc90 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f80c44d0 con 0x7f91f80ccc90 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0072d0 con 0x7f91f80ccc90 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.428+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f80c4a90 con 0x7f91f80ccc90 2023-06-09T04:39:13.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.429+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f8066570 con 0x7f91f80ccc90 2023-06-09T04:39:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.430+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91ec007430 con 0x7f91f80ccc90 2023-06-09T04:39:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.430+0000 7f91df7fe700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f91e406ace0 0x7f91e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.430+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f91ec088f70 con 0x7f91f80ccc90 2023-06-09T04:39:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.430+0000 7f91f6ffd700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f91e406ace0 0x7f91e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.431+0000 7f91f6ffd700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f91e406ace0 0x7f91e406d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91e8001ba0 tx=0x7f91e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.435+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91ec0bb310 con 0x7f91f80ccc90 2023-06-09T04:39:13.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:13.648+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f91f80c4c50 con 0x7f91f80ccc90 2023-06-09T04:39:14.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.403+0000 7f91df7fe700 1 -- 172.21.15.26:0/3497270509 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f91ec054320 con 0x7f91f80ccc90 2023-06-09T04:39:14.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f91e406ace0 msgr2=0x7f91e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f91e406ace0 0x7f91e406d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91e8001ba0 tx=0x7f91e8009040 comp rx=0 tx=0).stop 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 msgr2=0x7f91f80c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 0x7f91f80c9000 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0011e0 tx=0x7f91ec00ca50 comp rx=0 tx=0).stop 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 shutdown_connections 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91f815d780 0x7f91f8150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91f80caf70 0x7f91f806f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f91e406ace0 0x7f91e406d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 --2- 172.21.15.26:0/3497270509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91f80ccc90 0x7f91f80c9000 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 >> 172.21.15.26:0/3497270509 conn(0x7f91f8089fc0 msgr2=0x7f91f80b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 shutdown_connections 2023-06-09T04:39:14.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.406+0000 7f91fd562700 1 -- 172.21.15.26:0/3497270509 wait complete. 2023-06-09T04:39:14.409 INFO:teuthology.orchestra.run.smithi026.stderr: removed all blocklist entries 2023-06-09T04:39:14.423 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-09T04:39:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.554+0000 7f7169991700 1 Processor -- start 2023-06-09T04:39:14.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.554+0000 7f7169991700 1 -- start start 2023-06-09T04:39:14.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7169991700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7164159d00 0x7f716415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7169991700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71640d1840 0x7f71640cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7169991700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71640d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7169991700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71640ceec0 con 0x7f71640d1840 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7169991700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71640cf400 con 0x7f7164159d00 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7169991700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716415d830 con 0x7f71640cfdd0 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71640d1840 0x7f71640cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71640d1840 0x7f71640cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39808/0 (socket says 172.21.15.26:39808) 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 -- 172.21.15.26:0/1097976068 learned_addr learned my addr 172.21.15.26:0/1097976068 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7162ffd700 1 --2- 172.21.15.26:0/1097976068 >> v2:172.21.15.104:3300/0 conn(0x7f7164159d00 0x7f716415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 -- 172.21.15.26:0/1097976068 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 msgr2=0x7f71640d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 --2- 172.21.15.26:0/1097976068 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71640d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 -- 172.21.15.26:0/1097976068 >> v2:172.21.15.104:3300/0 conn(0x7f7164159d00 msgr2=0x7f716415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 --2- 172.21.15.26:0/1097976068 >> v2:172.21.15.104:3300/0 conn(0x7f7164159d00 0x7f716415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 -- 172.21.15.26:0/1097976068 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640cf0d0 con 0x7f71640d1840 2023-06-09T04:39:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7162ffd700 1 --2- 172.21.15.26:0/1097976068 >> v2:172.21.15.104:3300/0 conn(0x7f7164159d00 0x7f716415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f71627fc700 1 --2- 172.21.15.26:0/1097976068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f71640cf890 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f716408be50 tx=0x7f7158009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bc52a4b0bb0e24 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7161ffb700 1 -- 172.21.15.26:0/1097976068 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715800b870 con 0x7f71640d1840 2023-06-09T04:39:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7161ffb700 1 -- 172.21.15.26:0/1097976068 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715800b9d0 con 0x7f71640d1840 2023-06-09T04:39:14.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.555+0000 7f7161ffb700 1 -- 172.21.15.26:0/1097976068 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715800bd60 con 0x7f71640d1840 2023-06-09T04:39:14.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 -- 172.21.15.26:0/1097976068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 msgr2=0x7f71640cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 --2- 172.21.15.26:0/1097976068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f71640cf890 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f716408be50 tx=0x7f7158009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 -- 172.21.15.26:0/1097976068 shutdown_connections 2023-06-09T04:39:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 --2- 172.21.15.26:0/1097976068 >> v2:172.21.15.104:3300/0 conn(0x7f7164159d00 0x7f716415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 --2- 172.21.15.26:0/1097976068 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71640d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 --2- 172.21.15.26:0/1097976068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f71640cf890 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 -- 172.21.15.26:0/1097976068 >> 172.21.15.26:0/1097976068 conn(0x7f71640714e0 msgr2=0x7f71640718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 -- 172.21.15.26:0/1097976068 shutdown_connections 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.556+0000 7f7169991700 1 -- 172.21.15.26:0/1097976068 wait complete. 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.557+0000 7f7169991700 1 Processor -- start 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.557+0000 7f7169991700 1 -- start start 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7169991700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71641482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7169991700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f7164148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7169991700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7164159d00 0x7f71640c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7169991700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641487e0 con 0x7f71640d1840 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7169991700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71640ccf10 con 0x7f7164159d00 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7169991700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71640c74f0 con 0x7f71640cfdd0 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f71627fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f7164148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f71627fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f7164148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39816/0 (socket says 172.21.15.26:39816) 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f71627fc700 1 -- 172.21.15.26:0/2865470021 learned_addr learned my addr 172.21.15.26:0/2865470021 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f7162ffd700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71641482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.558+0000 7f71637fe700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7164159d00 0x7f71640c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71627fc700 1 -- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 msgr2=0x7f71641482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71627fc700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71641482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71627fc700 1 -- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7164159d00 msgr2=0x7f71640c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71627fc700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7164159d00 0x7f71640c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71627fc700 1 -- 172.21.15.26:0/2865470021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009550 con 0x7f71640d1840 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71637fe700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7164159d00 0x7f71640c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f71627fc700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f7164148a80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f71640d3d40 tx=0x7f7158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158004310 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715801f070 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71640c7790 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580036a0 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.559+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71640c7d50 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.560+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71640c7f70 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.560+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7158021030 con 0x7f71640d1840 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.561+0000 7f714bfff700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f715006ace0 0x7f715006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.561+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f715808a5b0 con 0x7f71640d1840 2023-06-09T04:39:14.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.561+0000 7f7162ffd700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f715006ace0 0x7f715006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.561+0000 7f7162ffd700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f715006ace0 0x7f715006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f716414bc30 tx=0x7f7154008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.565+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71580559c0 con 0x7f71640d1840 2023-06-09T04:39:14.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.849+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7164073ba0 con 0x7f71640d1840 2023-06-09T04:39:14.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.850+0000 7f714bfff700 1 -- 172.21.15.26:0/2865470021 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7158058fe0 con 0x7f71640d1840 2023-06-09T04:39:14.851 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:14.851 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-06-09T04:39:14.851 INFO:teuthology.orchestra.run.smithi026.stdout: "auth_dump": [ 2023-06-09T04:39:14.851 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.852 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.a", 2023-06-09T04:39:14.852 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkRd2hCBAA/CDx+XtQObi68LCMk67Rxw==", 2023-06-09T04:39:14.852 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.852 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.852 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-06-09T04:39:14.852 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.b", 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkyckvFRAAaMBxY9/TRxanep12TWzdag==", 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.c", 2023-06-09T04:39:14.854 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkXp41EBAAnxvzgERGjiBN2uK7Ik5rrw==", 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.855 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mds.d", 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkUHliHBAAxssDZuHqL0afakpO77fv2A==", 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-06-09T04:39:14.856 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.0", 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCCrIJkJn9BDBAAA24LsbeM7qLDhs388wcIIg==", 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.857 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.858 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.858 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.858 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.858 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.858 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.1", 2023-06-09T04:39:14.858 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCFrIJkYVi5DBAAb0q+LvKEZkm9yC+8ojtC7Q==", 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.859 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.2", 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCIrIJkfKGuDRAAPHd4Q+yT6G0XilgTcRiivw==", 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.860 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.3", 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCLrIJk13UnDhAA6HlaMgGtAeuu7h3hKk4jFw==", 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.861 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.4", 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCRrIJkA/NWFBAAO6Dkf3oLYoCXraoCEqM5/Q==", 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.862 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.5", 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCUrIJkqdVkExAA4gg+Ua/Jdk0jowmE9OM4sA==", 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.863 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.6", 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCXrIJkdcexExAAESYNtCZe1wFD52aVNG9/QQ==", 2023-06-09T04:39:14.864 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "osd.7", 2023-06-09T04:39:14.865 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCarIJkn/DtEhAA1odsDw+hbXfPiXAEC01NPw==", 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile osd", 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.866 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.0", 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJk8fHrIBAA7VGb53yvYzI8Y46r1nqGSA==", 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.867 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.1", 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkgjDIJxAASSMA4JaBonc9G32FRHb5Ng==", 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-06-09T04:39:14.868 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.2", 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkIe1nJBAA3UUKUyeKePFBmslRh+JwwQ==", 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.869 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.3", 2023-06-09T04:39:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkf7p8LRAAtXhGAgE8d3iHbw/attBR/Q==", 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow", 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow r", 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow rw", 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow rwx" 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.871 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.admin", 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQB/rIJkHvFQJxAA7pAYeiK6JZ48fTWjQpji/Q==", 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": "allow *", 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow *", 2023-06-09T04:39:14.872 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mds", 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCgrIJkTFunEBAAQncJIEi1B/yaMuV5euqhUA==", 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mds" 2023-06-09T04:39:14.873 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-mgr", 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCgrIJkFGanEBAAK8HHO4eFtChDY6Tis+7vfg==", 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.874 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-osd", 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCgrIJkHW6nEBAAFlxdQDVcNbxhWPymIrvB/A==", 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-osd" 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.875 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd", 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCgrIJk93WnEBAAkmgcmZkWwtmW3rm1HfEozw==", 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.876 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCgrIJkan+nEBAAklwPAa6jUWBRLVDlMYjsCg==", 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.877 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "client.bootstrap-rgw", 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCgrIJkj4enEBAAyHQ38TgK4oh8rDcYKuiBLw==", 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.878 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.x", 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkqSYUBRAA47Oz3mXAfq9H/Wv5uxGEDA==", 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.879 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: "entity": "mgr.y", 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: "key": "AQCArIJkxvFXARAAgf7OtM96Ke8FUCXxHBI3Kg==", 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": { 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": "allow *", 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": "allow profile mgr", 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": "allow *" 2023-06-09T04:39:14.880 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.881 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:14.881 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-06-09T04:39:14.881 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-06-09T04:39:14.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f715006ace0 msgr2=0x7f715006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f715006ace0 0x7f715006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f716414bc30 tx=0x7f7154008040 comp rx=0 tx=0).stop 2023-06-09T04:39:14.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 msgr2=0x7f7164148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f7164148a80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f71640d3d40 tx=0x7f7158004750 comp rx=0 tx=0).stop 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 shutdown_connections 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7164159d00 0x7f71640c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71640cfdd0 0x7f71641482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f715006ace0 0x7f715006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 --2- 172.21.15.26:0/2865470021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71640d1840 0x7f7164148a80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 >> 172.21.15.26:0/2865470021 conn(0x7f71640714e0 msgr2=0x7f716415bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 shutdown_connections 2023-06-09T04:39:14.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:14.852+0000 7f7169991700 1 -- 172.21.15.26:0/2865470021 wait complete. 2023-06-09T04:39:14.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-09T04:39:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.009+0000 7fa4cc965700 1 Processor -- start 2023-06-09T04:39:15.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.009+0000 7fa4cc965700 1 -- start start 2023-06-09T04:39:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4cc965700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa4c815a310 0x7fa4c80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4cc965700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c80ac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4cc965700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c80cd880 con 0x7fa4c8098ea0 2023-06-09T04:39:15.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4cc965700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c80ce280 con 0x7fa4c815a310 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4cc965700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c80cdb60 con 0x7fa4c815a6e0 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c5d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c80ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c659c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa4c815a310 0x7fa4c80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c5d9b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c80ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50482/0 (socket says 172.21.15.26:50482) 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c5d9b700 1 -- 172.21.15.26:0/3828097147 learned_addr learned my addr 172.21.15.26:0/3828097147 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c659c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa4c815a310 0x7fa4c80cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:46942/0 (socket says 172.21.15.26:46942) 2023-06-09T04:39:15.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c6d9d700 1 --1- 172.21.15.26:0/3828097147 >> v1:172.21.15.104:6789/0 conn(0x7fa4c8098ea0 0x7fa4c8069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:47596/0 (socket says 172.21.15.26:47596) 2023-06-09T04:39:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c659c700 1 -- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 msgr2=0x7fa4c80ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c659c700 1 --2- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c80ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c659c700 1 -- 172.21.15.26:0/3828097147 >> v1:172.21.15.104:6789/0 conn(0x7fa4c8098ea0 legacy=0x7fa4c8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.010+0000 7fa4c559a700 1 -- 172.21.15.26:0/3828097147 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418210307 0 0) 0x7fa4c80cd880 con 0x7fa4c8098ea0 2023-06-09T04:39:15.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c659c700 1 -- 172.21.15.26:0/3828097147 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c806e190 con 0x7fa4c815a310 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c5d9b700 1 --2- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c80ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c659c700 1 --2- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80cede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009820 tx=0x7fa4b8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc277d09387570a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c559a700 1 -- 172.21.15.26:0/3828097147 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8005e30 con 0x7fa4c815a310 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c559a700 1 -- 172.21.15.26:0/3828097147 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8006030 con 0x7fa4c815a310 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4c559a700 1 -- 172.21.15.26:0/3828097147 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80063c0 con 0x7fa4c815a310 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4cc965700 1 -- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 msgr2=0x7fa4c80cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.011+0000 7fa4cc965700 1 --2- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80cede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009820 tx=0x7fa4b8009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.012+0000 7fa4cc965700 1 -- 172.21.15.26:0/3828097147 shutdown_connections 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.012+0000 7fa4cc965700 1 --2- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80cede0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.012+0000 7fa4cc965700 1 --2- 172.21.15.26:0/3828097147 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c80ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.012+0000 7fa4cc965700 1 -- 172.21.15.26:0/3828097147 >> 172.21.15.26:0/3828097147 conn(0x7fa4c8098a30 msgr2=0x7fa4c80cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.012+0000 7fa4cc965700 1 -- 172.21.15.26:0/3828097147 shutdown_connections 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.012+0000 7fa4cc965700 1 -- 172.21.15.26:0/3828097147 wait complete. 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.013+0000 7fa4cc965700 1 Processor -- start 2023-06-09T04:39:15.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.013+0000 7fa4cc965700 1 -- start start 2023-06-09T04:39:15.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4cc965700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 0x7fa4c81ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4cc965700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4cc965700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4cc965700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c80c6170 con 0x7fa4c8098ea0 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4cc965700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81524b0 con 0x7fa4c815a310 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4cc965700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8152750 con 0x7fa4c815a6e0 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 0x7fa4c81ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 0x7fa4c81ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39828/0 (socket says 172.21.15.26:39828) 2023-06-09T04:39:15.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 -- 172.21.15.26:0/2911973302 learned_addr learned my addr 172.21.15.26:0/2911973302 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c5d9b700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c6d9d700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 -- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 msgr2=0x7fa4c8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c8151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 -- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 msgr2=0x7fa4c80c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 -- 172.21.15.26:0/2911973302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009550 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4c659c700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 0x7fa4c81ef6f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8000c00 tx=0x7fa4b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.014+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80061a0 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.015+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8020070 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.015+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b8009430 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.015+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8006540 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.015+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c8152d10 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.015+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c8067180 con 0x7fa4c8098ea0 2023-06-09T04:39:15.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.016+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4b8022030 con 0x7fa4c8098ea0 2023-06-09T04:39:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.016+0000 7fa4b6ffd700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa4a806ace0 0x7fa4a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.016+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa4b808a550 con 0x7fa4c8098ea0 2023-06-09T04:39:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.017+0000 7fa4c5d9b700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa4a806ace0 0x7fa4a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.017+0000 7fa4c5d9b700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa4a806ace0 0x7fa4a806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8156d70 tx=0x7fa4bc0092c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.021+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4b80559e0 con 0x7fa4c8098ea0 2023-06-09T04:39:15.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.298+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa4c80c32f0 con 0x7fa4c8098ea0 2023-06-09T04:39:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.302+0000 7fa4b6ffd700 1 -- 172.21.15.26:0/2911973302 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa4b8059000 con 0x7fa4c8098ea0 2023-06-09T04:39:15.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa4a806ace0 msgr2=0x7fa4a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa4a806ace0 0x7fa4a806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8156d70 tx=0x7fa4bc0092c0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 msgr2=0x7fa4c81ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 0x7fa4c81ef6f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8000c00 tx=0x7fa4b8004750 comp rx=0 tx=0).stop 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 shutdown_connections 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa4c815a6e0 0x7fa4c8151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fa4a806ace0 0x7fa4a806d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4c8098ea0 0x7fa4c81ef6f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 --2- 172.21.15.26:0/2911973302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4c815a310 0x7fa4c80c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 >> 172.21.15.26:0/2911973302 conn(0x7fa4c8098a30 msgr2=0x7fa4c80ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 shutdown_connections 2023-06-09T04:39:15.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.304+0000 7fa4cc965700 1 -- 172.21.15.26:0/2911973302 wait complete. 2023-06-09T04:39:15.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-09T04:39:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.441+0000 7f5e3a447700 1 Processor -- start 2023-06-09T04:39:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.441+0000 7f5e3a447700 1 -- start start 2023-06-09T04:39:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e3a447700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e3415d780 0x7f5e340b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e3a447700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5e340b07c0 0x7f5e340cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e3a447700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e340cc0f0 con 0x7f5e340caf70 2023-06-09T04:39:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e3a447700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340b00a0 con 0x7f5e340b07c0 2023-06-09T04:39:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e3a447700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340cfc20 con 0x7f5e3415d780 2023-06-09T04:39:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e389e4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5e340caf70 0x7f5e340ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48698/0 (socket says 172.21.15.26:48698) 2023-06-09T04:39:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e389e4700 1 -- 172.21.15.26:0/425591163 learned_addr learned my addr 172.21.15.26:0/425591163 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e337fe700 1 --2- 172.21.15.26:0/425591163 >> v2:172.21.15.104:3300/0 conn(0x7f5e340b07c0 0x7f5e340cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.442+0000 7f5e33fff700 1 --2- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e3415d780 0x7f5e340b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e32ffd700 1 -- 172.21.15.26:0/425591163 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451398644 0 0) 0x7f5e340cc0f0 con 0x7f5e340caf70 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e32ffd700 1 -- 172.21.15.26:0/425591163 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e1c0035b0 con 0x7f5e340caf70 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e337fe700 1 -- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e3415d780 msgr2=0x7f5e340b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e337fe700 1 --2- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e3415d780 0x7f5e340b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e337fe700 1 -- 172.21.15.26:0/425591163 >> v1:172.21.15.26:6789/0 conn(0x7f5e340caf70 legacy=0x7f5e340ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e337fe700 1 -- 172.21.15.26:0/425591163 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340cb4e0 con 0x7f5e340b07c0 2023-06-09T04:39:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e337fe700 1 --2- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e340b07c0 0x7f5e340cc580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009840 tx=0x7f5e24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb38fa4826976aa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e32ffd700 1 -- 172.21.15.26:0/425591163 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24011830 con 0x7f5e340b07c0 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e32ffd700 1 -- 172.21.15.26:0/425591163 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24011990 con 0x7f5e340b07c0 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.443+0000 7f5e32ffd700 1 -- 172.21.15.26:0/425591163 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24011d00 con 0x7f5e340b07c0 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 -- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e340b07c0 msgr2=0x7f5e340cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 --2- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e340b07c0 0x7f5e340cc580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009840 tx=0x7f5e24009b50 comp rx=0 tx=0).stop 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 -- 172.21.15.26:0/425591163 shutdown_connections 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 --2- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e3415d780 0x7f5e340b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 --2- 172.21.15.26:0/425591163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e340b07c0 0x7f5e340cc580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 -- 172.21.15.26:0/425591163 >> 172.21.15.26:0/425591163 conn(0x7f5e34089fc0 msgr2=0x7f5e340d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 -- 172.21.15.26:0/425591163 shutdown_connections 2023-06-09T04:39:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.444+0000 7f5e3a447700 1 -- 172.21.15.26:0/425591163 wait complete. 2023-06-09T04:39:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.445+0000 7f5e3a447700 1 Processor -- start 2023-06-09T04:39:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.445+0000 7f5e3a447700 1 -- start start 2023-06-09T04:39:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e3a447700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e340b07c0 0x7f5e340b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e3a447700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 0x7f5e34159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e3a447700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e3415d780 0x7f5e340b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e3a447700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3406b8d0 con 0x7f5e340caf70 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e3a447700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3406c410 con 0x7f5e3415d780 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e3a447700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34159840 con 0x7f5e340b07c0 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 0x7f5e34159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 0x7f5e34159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39844/0 (socket says 172.21.15.26:39844) 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 -- 172.21.15.26:0/2713344295 learned_addr learned my addr 172.21.15.26:0/2713344295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e389e4700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e3415d780 0x7f5e340b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e33fff700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e340b07c0 0x7f5e340b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 -- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e340b07c0 msgr2=0x7f5e340b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e340b07c0 0x7f5e340b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 -- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e3415d780 msgr2=0x7f5e340b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e3415d780 0x7f5e340b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.446+0000 7f5e337fe700 1 -- 172.21.15.26:0/2713344295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e240094a0 con 0x7f5e340caf70 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.447+0000 7f5e337fe700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 0x7f5e34159300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009fd0 tx=0x7f5e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.447+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24004550 con 0x7f5e340caf70 2023-06-09T04:39:15.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.447+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2401f070 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.447+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3406bae0 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.447+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240038e0 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.447+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3406c0a0 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.448+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3406c230 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.448+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e24003a40 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.449+0000 7f5e30ff9700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e2006ad10 0x7f5e2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.449+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5e24021070 con 0x7f5e340caf70 2023-06-09T04:39:15.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.449+0000 7f5e33fff700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e2006ad10 0x7f5e2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.449+0000 7f5e33fff700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e2006ad10 0x7f5e2006d1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009b20 tx=0x7f5e280091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.453+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e24055c70 con 0x7f5e340caf70 2023-06-09T04:39:15.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.730+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5e34066570 con 0x7f5e340caf70 2023-06-09T04:39:15.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.734+0000 7f5e30ff9700 1 -- 172.21.15.26:0/2713344295 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5e24059290 con 0x7f5e340caf70 2023-06-09T04:39:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e2006ad10 msgr2=0x7f5e2006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e2006ad10 0x7f5e2006d1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009b20 tx=0x7f5e280091c0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 msgr2=0x7f5e34159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 0x7f5e34159300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009fd0 tx=0x7f5e24004750 comp rx=0 tx=0).stop 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 shutdown_connections 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e3415d780 0x7f5e340b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5e340b07c0 0x7f5e340b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5e2006ad10 0x7f5e2006d1c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 --2- 172.21.15.26:0/2713344295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5e340caf70 0x7f5e34159300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 >> 172.21.15.26:0/2713344295 conn(0x7f5e34089fc0 msgr2=0x7f5e340cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 shutdown_connections 2023-06-09T04:39:15.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.736+0000 7f5e3a447700 1 -- 172.21.15.26:0/2713344295 wait complete. 2023-06-09T04:39:15.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-09T04:39:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.874+0000 7f3c5fd0b700 1 Processor -- start 2023-06-09T04:39:15.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.874+0000 7f3c5fd0b700 1 -- start start 2023-06-09T04:39:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5fd0b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 0x7f3c580b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5fd0b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3c580b07c0 0x7f3c580cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5fd0b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c580cc0f0 con 0x7f3c580caf70 2023-06-09T04:39:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5fd0b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580b00a0 con 0x7f3c580b07c0 2023-06-09T04:39:15.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5fd0b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580cfc20 con 0x7f3c5815d780 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 0x7f3c580b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5d2a6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3c580b07c0 0x7f3c580cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 0x7f3c580b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50508/0 (socket says 172.21.15.26:50508) 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 -- 172.21.15.26:0/469416224 learned_addr learned my addr 172.21.15.26:0/469416224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 -- 172.21.15.26:0/469416224 >> v2:172.21.15.104:3300/0 conn(0x7f3c580b07c0 msgr2=0x7f3c580cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 --2- 172.21.15.26:0/469416224 >> v2:172.21.15.104:3300/0 conn(0x7f3c580b07c0 0x7f3c580cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 -- 172.21.15.26:0/469416224 >> v1:172.21.15.104:6789/0 conn(0x7f3c580caf70 legacy=0x7f3c580ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5daa7700 1 -- 172.21.15.26:0/469416224 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580cb4e0 con 0x7f3c5815d780 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.875+0000 7f3c5d2a6700 1 --2- 172.21.15.26:0/469416224 >> v2:172.21.15.104:3300/0 conn(0x7f3c580b07c0 0x7f3c580cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5daa7700 1 --2- 172.21.15.26:0/469416224 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 0x7f3c580b0280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006fd0 tx=0x7f3c54009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c713a7189b6c51 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5caa5700 1 -- 172.21.15.26:0/469416224 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54005e30 con 0x7f3c5815d780 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5caa5700 1 -- 172.21.15.26:0/469416224 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54004030 con 0x7f3c5815d780 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5caa5700 1 -- 172.21.15.26:0/469416224 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540043e0 con 0x7f3c5815d780 2023-06-09T04:39:15.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/469416224 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 msgr2=0x7f3c580b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/469416224 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 0x7f3c580b0280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006fd0 tx=0x7f3c54009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/469416224 shutdown_connections 2023-06-09T04:39:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/469416224 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c5815d780 0x7f3c580b0280 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/469416224 >> v2:172.21.15.104:3300/0 conn(0x7f3c580b07c0 0x7f3c580cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/469416224 >> 172.21.15.26:0/469416224 conn(0x7f3c58089fc0 msgr2=0x7f3c580d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/469416224 shutdown_connections 2023-06-09T04:39:15.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.876+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/469416224 wait complete. 2023-06-09T04:39:15.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 Processor -- start 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 -- start start 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 0x7f3c5815bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c580caf70 0x7f3c580c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3c5815d780 0x7f3c580c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5806bca0 con 0x7f3c580b07c0 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5806b040 con 0x7f3c5815d780 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5fd0b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5806b300 con 0x7f3c580caf70 2023-06-09T04:39:15.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.878+0000 7f3c5daa7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 0x7f3c5815bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 0x7f3c5815bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39854/0 (socket says 172.21.15.26:39854) 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 -- 172.21.15.26:0/861289725 learned_addr learned my addr 172.21.15.26:0/861289725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5d2a6700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c580caf70 0x7f3c580c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5e2a8700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3c5815d780 0x7f3c580c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 -- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c580caf70 msgr2=0x7f3c580c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c580caf70 0x7f3c580c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 -- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3c5815d780 msgr2=0x7f3c580c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3c5815d780 0x7f3c580c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 -- 172.21.15.26:0/861289725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480094a0 con 0x7f3c580b07c0 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5daa7700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 0x7f3c5815bde0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009c10 tx=0x7f3c54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54003c70 con 0x7f3c580b07c0 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54003df0 con 0x7f3c580b07c0 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c54009500 con 0x7f3c580b07c0 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5401d670 con 0x7f3c580b07c0 2023-06-09T04:39:15.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.879+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5806b8c0 con 0x7f3c580b07c0 2023-06-09T04:39:15.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.880+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c58066570 con 0x7f3c580b07c0 2023-06-09T04:39:15.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.881+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c5401d7d0 con 0x7f3c580b07c0 2023-06-09T04:39:15.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.881+0000 7f3c4e7fc700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3c3c06ace0 0x7f3c3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.881+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3c5408a2f0 con 0x7f3c580b07c0 2023-06-09T04:39:15.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.881+0000 7f3c5d2a6700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3c3c06ace0 0x7f3c3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.882+0000 7f3c5d2a6700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3c3c06ace0 0x7f3c3c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c5806d080 tx=0x7f3c48009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:15.886+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c54055780 con 0x7f3c580b07c0 2023-06-09T04:39:16.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.161+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3c580b0420 con 0x7f3c580b07c0 2023-06-09T04:39:16.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.165+0000 7f3c4e7fc700 1 -- 172.21.15.26:0/861289725 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3c54058da0 con 0x7f3c580b07c0 2023-06-09T04:39:16.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3c3c06ace0 msgr2=0x7f3c3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3c3c06ace0 0x7f3c3c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c5806d080 tx=0x7f3c48009210 comp rx=0 tx=0).stop 2023-06-09T04:39:16.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 msgr2=0x7f3c5815bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 0x7f3c5815bde0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009c10 tx=0x7f3c54004750 comp rx=0 tx=0).stop 2023-06-09T04:39:16.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 shutdown_connections 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3c5815d780 0x7f3c580c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3c3c06ace0 0x7f3c3c06d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c580b07c0 0x7f3c5815bde0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 --2- 172.21.15.26:0/861289725 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3c580caf70 0x7f3c580c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 >> 172.21.15.26:0/861289725 conn(0x7f3c58089fc0 msgr2=0x7f3c580b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 shutdown_connections 2023-06-09T04:39:16.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.168+0000 7f3c5fd0b700 1 -- 172.21.15.26:0/861289725 wait complete. 2023-06-09T04:39:16.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-09T04:39:16.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.306+0000 7fbfcde56700 1 Processor -- start 2023-06-09T04:39:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.306+0000 7fbfcde56700 1 -- start start 2023-06-09T04:39:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.307+0000 7fbfcde56700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 0x7fbfc80cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.307+0000 7fbfcde56700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80cf350 con 0x7fbfc80b4c70 2023-06-09T04:39:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.307+0000 7fbfcde56700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80cd1d0 con 0x7fbfc80b5930 2023-06-09T04:39:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.307+0000 7fbfcde56700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80cd4b0 con 0x7fbfc815c440 2023-06-09T04:39:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.307+0000 7fbfc7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbfc80b4c70 0x7fbfc80d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48724/0 (socket says 172.21.15.26:48724) 2023-06-09T04:39:16.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.307+0000 7fbfc7fff700 1 -- 172.21.15.26:0/1633346136 learned_addr learned my addr 172.21.15.26:0/1633346136 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc77fe700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 0x7fbfc80cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215259572 0 0) 0x7fbfc80cf350 con 0x7fbfc80b4c70 2023-06-09T04:39:16.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb00035b0 con 0x7fbfc80b4c70 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616217140 0 0) 0x7fbfb00035b0 con 0x7fbfc80b4c70 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 msgr2=0x7fbfc80cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 0x7fbfc80cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 >> v1:172.21.15.104:6789/0 conn(0x7fbfc80b5930 legacy=0x7fbfc80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80cd790 con 0x7fbfc80b4c70 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fbfc00019f0 con 0x7fbfc80b4c70 2023-06-09T04:39:16.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 >> v1:172.21.15.26:6789/0 conn(0x7fbfc80b4c70 legacy=0x7fbfc80d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 0x7fbfb0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfb0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb0004d90 0x7fbfb0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80cd4b0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb000bba0 con 0x7fbfb0004d90 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb000bd60 con 0x7fbfc815c440 2023-06-09T04:39:16.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfb0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc77fe700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 0x7fbfb0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc7fff700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb0004d90 0x7fbfb0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc6ffd700 1 -- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 msgr2=0x7fbfb0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc815c440 0x7fbfb0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc6ffd700 1 -- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb0004d90 msgr2=0x7fbfb0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb0004d90 0x7fbfb0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc6ffd700 1 -- 172.21.15.26:0/1633346136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00035b0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.308+0000 7fbfc7fff700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb0004d90 0x7fbfb0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfb0004850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc007fd0 tx=0x7fbfb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54e39dcd0671fe server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0012f0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc0052f0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfc67fc700 1 -- 172.21.15.26:0/1633346136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc006860 con 0x7fbfb0003fb0 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfcde56700 1 -- 172.21.15.26:0/1633346136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 msgr2=0x7fbfb0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1633346136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfb0004850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc007fd0 tx=0x7fbfb0005880 comp rx=0 tx=0).stop 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfc7fff700 1 -- 172.21.15.26:0/1633346136 reap_dead start 2023-06-09T04:39:16.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfcde56700 1 -- 172.21.15.26:0/1633346136 shutdown_connections 2023-06-09T04:39:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfcde56700 1 -- 172.21.15.26:0/1633346136 >> 172.21.15.26:0/1633346136 conn(0x7fbfc80cf560 msgr2=0x7fbfc80cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfcde56700 1 -- 172.21.15.26:0/1633346136 shutdown_connections 2023-06-09T04:39:16.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.309+0000 7fbfcde56700 1 -- 172.21.15.26:0/1633346136 wait complete. 2023-06-09T04:39:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.311+0000 7fbfcde56700 1 Processor -- start 2023-06-09T04:39:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.311+0000 7fbfcde56700 1 -- start start 2023-06-09T04:39:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfc8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc81f26b0 0x7fbfc815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfc815a870 0x7fbfc815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80cafa0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc815b250 con 0x7fbfc815a870 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81f5af0 con 0x7fbfc81f26b0 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfc8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfc8158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39874/0 (socket says 172.21.15.26:39874) 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 -- 172.21.15.26:0/1224636802 learned_addr learned my addr 172.21.15.26:0/1224636802 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:16.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc81f26b0 0x7fbfc815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc7fff700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfc815a870 0x7fbfc815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 -- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc81f26b0 msgr2=0x7fbfc815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc81f26b0 0x7fbfc815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 -- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfc815a870 msgr2=0x7fbfc815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfc815a870 0x7fbfc815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 -- 172.21.15.26:0/1224636802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc81f4f00 con 0x7fbfb0003fb0 2023-06-09T04:39:16.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc81f26b0 0x7fbfc815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfc77fe700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfc8158160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8011aa0 tx=0x7fbfb8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800f980 con 0x7fbfb0003fb0 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb800fae0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc81f51c0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800fe90 con 0x7fbfb0003fb0 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.312+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc81f5780 con 0x7fbfb0003fb0 2023-06-09T04:39:16.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.313+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc806b9e0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.314+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbfb8014440 con 0x7fbfb0003fb0 2023-06-09T04:39:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.314+0000 7fbfaffff700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbfb406ace0 0x7fbfb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.314+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbfb8089950 con 0x7fbfb0003fb0 2023-06-09T04:39:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.314+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbfb406ace0 0x7fbfb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.315+0000 7fbfc6ffd700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbfb406ace0 0x7fbfb406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc014040 tx=0x7fbfbc011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.319+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbfb80588a0 con 0x7fbfb0003fb0 2023-06-09T04:39:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.596+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbfc806b700 con 0x7fbfb0003fb0 2023-06-09T04:39:16.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.599+0000 7fbfaffff700 1 -- 172.21.15.26:0/1224636802 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbfb8058430 con 0x7fbfb0003fb0 2023-06-09T04:39:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbfb406ace0 msgr2=0x7fbfb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbfb406ace0 0x7fbfb406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc014040 tx=0x7fbfbc011000 comp rx=0 tx=0).stop 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 msgr2=0x7fbfc8158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfc8158160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8011aa0 tx=0x7fbfb8011e60 comp rx=0 tx=0).stop 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 shutdown_connections 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfc815a870 0x7fbfc815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbfb406ace0 0x7fbfb406d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb0003fb0 0x7fbfc8158160 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 --2- 172.21.15.26:0/1224636802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbfc81f26b0 0x7fbfc815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 >> 172.21.15.26:0/1224636802 conn(0x7fbfc80cf560 msgr2=0x7fbfc8159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 shutdown_connections 2023-06-09T04:39:16.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.601+0000 7fbfcde56700 1 -- 172.21.15.26:0/1224636802 wait complete. 2023-06-09T04:39:16.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-09T04:39:16.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.739+0000 7fc21a1cb700 1 Processor -- start 2023-06-09T04:39:16.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.739+0000 7fc21a1cb700 1 -- start start 2023-06-09T04:39:16.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc21a1cb700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc21415d780 0x7fc2140b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc21a1cb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc21a1cb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2140cc0f0 con 0x7fc2140b07c0 2023-06-09T04:39:16.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc21a1cb700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2140b00a0 con 0x7fc21415d780 2023-06-09T04:39:16.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc21a1cb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140cfc20 con 0x7fc2140ccc90 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2137fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc21415d780 0x7fc2140b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc212ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc2140b07c0 0x7fc2140cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48740/0 (socket says 172.21.15.26:48740) 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc212ffd700 1 -- 172.21.15.26:0/3464588172 learned_addr learned my addr 172.21.15.26:0/3464588172 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc213fff700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2127fc700 1 -- 172.21.15.26:0/3464588172 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190806936 0 0) 0x7fc2140cc0f0 con 0x7fc2140b07c0 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2127fc700 1 -- 172.21.15.26:0/3464588172 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2000035b0 con 0x7fc2140b07c0 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2137fe700 1 -- 172.21.15.26:0/3464588172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 msgr2=0x7fc2140ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2137fe700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2137fe700 1 -- 172.21.15.26:0/3464588172 >> v1:172.21.15.26:6789/0 conn(0x7fc2140b07c0 legacy=0x7fc2140cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc2137fe700 1 -- 172.21.15.26:0/3464588172 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140cb4e0 con 0x7fc21415d780 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.740+0000 7fc213fff700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc2137fe700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140b0280 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc204009820 tx=0x7fc204009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00d232f1ccffa5c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc2127fc700 1 -- 172.21.15.26:0/3464588172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204005e30 con 0x7fc21415d780 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc2127fc700 1 -- 172.21.15.26:0/3464588172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc204006030 con 0x7fc21415d780 2023-06-09T04:39:16.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc2127fc700 1 -- 172.21.15.26:0/3464588172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040063a0 con 0x7fc21415d780 2023-06-09T04:39:16.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 -- 172.21.15.26:0/3464588172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 msgr2=0x7fc2140b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140b0280 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc204009820 tx=0x7fc204009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 -- 172.21.15.26:0/3464588172 shutdown_connections 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/3464588172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140b0280 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 -- 172.21.15.26:0/3464588172 >> 172.21.15.26:0/3464588172 conn(0x7fc214089fc0 msgr2=0x7fc2140d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 -- 172.21.15.26:0/3464588172 shutdown_connections 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.741+0000 7fc21a1cb700 1 -- 172.21.15.26:0/3464588172 wait complete. 2023-06-09T04:39:16.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.743+0000 7fc21a1cb700 1 Processor -- start 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.743+0000 7fc21a1cb700 1 -- start start 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.743+0000 7fc21a1cb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2140b07c0 0x7fc21415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.743+0000 7fc21a1cb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc21a1cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc21a1cb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141f41f0 con 0x7fc21415d780 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc21a1cb700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140b65c0 con 0x7fc2140b07c0 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc21a1cb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141f3d60 con 0x7fc2140ccc90 2023-06-09T04:39:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39890/0 (socket says 172.21.15.26:39890) 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 -- 172.21.15.26:0/1477305424 learned_addr learned my addr 172.21.15.26:0/1477305424 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc212ffd700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc2137fe700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2140b07c0 0x7fc21415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 -- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 msgr2=0x7fc2140c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 -- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2140b07c0 msgr2=0x7fc21415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2140b07c0 0x7fc21415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 -- 172.21.15.26:0/1477305424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204009430 con 0x7fc21415d780 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc213fff700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140c6b40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc20c007ec0 tx=0x7fc20c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00dd80 con 0x7fc21415d780 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00f040 con 0x7fc21415d780 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2140c9ef0 con 0x7fc21415d780 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c003c60 con 0x7fc21415d780 2023-06-09T04:39:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.744+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2141f3710 con 0x7fc21415d780 2023-06-09T04:39:16.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.745+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2141f3ed0 con 0x7fc21415d780 2023-06-09T04:39:16.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.746+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc20c004030 con 0x7fc21415d780 2023-06-09T04:39:16.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.746+0000 7fc20bfff700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc1f406ace0 0x7fc1f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.746+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc20c0890e0 con 0x7fc21415d780 2023-06-09T04:39:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.746+0000 7fc2137fe700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc1f406ace0 0x7fc1f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.747+0000 7fc2137fe700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc1f406ace0 0x7fc1f406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc204013040 tx=0x7fc204008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:16.751+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc20c054570 con 0x7fc21415d780 2023-06-09T04:39:17.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.032+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc2140d06d0 con 0x7fc21415d780 2023-06-09T04:39:17.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.035+0000 7fc20bfff700 1 -- 172.21.15.26:0/1477305424 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc20c057b90 con 0x7fc21415d780 2023-06-09T04:39:17.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc1f406ace0 msgr2=0x7fc1f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc1f406ace0 0x7fc1f406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc204013040 tx=0x7fc204008070 comp rx=0 tx=0).stop 2023-06-09T04:39:17.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 msgr2=0x7fc2140c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140c6b40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc20c007ec0 tx=0x7fc20c00d3b0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 shutdown_connections 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc1f406ace0 0x7fc1f406d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21415d780 0x7fc2140c6b40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc2140b07c0 0x7fc21415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 --2- 172.21.15.26:0/1477305424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2140ccc90 0x7fc2140c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 >> 172.21.15.26:0/1477305424 conn(0x7fc214089fc0 msgr2=0x7fc2140ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 shutdown_connections 2023-06-09T04:39:17.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.038+0000 7fc21a1cb700 1 -- 172.21.15.26:0/1477305424 wait complete. 2023-06-09T04:39:17.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-09T04:39:17.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.175+0000 7f419bc90700 1 Processor -- start 2023-06-09T04:39:17.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.175+0000 7f419bc90700 1 -- start start 2023-06-09T04:39:17.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419bc90700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940aed90 0x7f41940c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419bc90700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41940ca370 0x7f41940ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419bc90700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41940ceae0 0x7f41940cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419bc90700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41940cda30 con 0x7f41940ca370 2023-06-09T04:39:17.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419bc90700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41940ca7e0 con 0x7f41940ceae0 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419bc90700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4194159880 con 0x7f41940aed90 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419922b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41940ca370 0x7f41940ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419922b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f41940ca370 0x7f41940ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39896/0 (socket says 172.21.15.26:39896) 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419922b700 1 -- 172.21.15.26:0/1843156749 learned_addr learned my addr 172.21.15.26:0/1843156749 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f4199a2c700 1 --2- 172.21.15.26:0/1843156749 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940aed90 0x7f41940c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.176+0000 7f419a22d700 1 --2- 172.21.15.26:0/1843156749 >> v2:172.21.15.104:3300/0 conn(0x7f41940ceae0 0x7f41940cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419922b700 1 -- 172.21.15.26:0/1843156749 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940aed90 msgr2=0x7f41940c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419922b700 1 --2- 172.21.15.26:0/1843156749 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940aed90 0x7f41940c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419922b700 1 -- 172.21.15.26:0/1843156749 >> v2:172.21.15.104:3300/0 conn(0x7f41940ceae0 msgr2=0x7f41940cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419922b700 1 --2- 172.21.15.26:0/1843156749 >> v2:172.21.15.104:3300/0 conn(0x7f41940ceae0 0x7f41940cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419922b700 1 -- 172.21.15.26:0/1843156749 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419406cff0 con 0x7f41940ca370 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419922b700 1 --2- 172.21.15.26:0/1843156749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ca370 0x7f41940ce5a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f41940cd2a0 tx=0x7f4190009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f81a2d271cb2a51 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f4198a2a700 1 -- 172.21.15.26:0/1843156749 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011830 con 0x7f41940ca370 2023-06-09T04:39:17.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f4198a2a700 1 -- 172.21.15.26:0/1843156749 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190011990 con 0x7f41940ca370 2023-06-09T04:39:17.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f4198a2a700 1 -- 172.21.15.26:0/1843156749 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011d20 con 0x7f41940ca370 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419bc90700 1 -- 172.21.15.26:0/1843156749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ca370 msgr2=0x7f41940ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419bc90700 1 --2- 172.21.15.26:0/1843156749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ca370 0x7f41940ce5a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f41940cd2a0 tx=0x7f4190009c00 comp rx=0 tx=0).stop 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419bc90700 1 -- 172.21.15.26:0/1843156749 shutdown_connections 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419bc90700 1 --2- 172.21.15.26:0/1843156749 >> v2:172.21.15.104:3300/0 conn(0x7f41940ceae0 0x7f41940cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.177+0000 7f419bc90700 1 --2- 172.21.15.26:0/1843156749 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940aed90 0x7f41940c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.178+0000 7f419bc90700 1 --2- 172.21.15.26:0/1843156749 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ca370 0x7f41940ce5a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.178+0000 7f419bc90700 1 -- 172.21.15.26:0/1843156749 >> 172.21.15.26:0/1843156749 conn(0x7f4194098a30 msgr2=0x7f41940cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.178+0000 7f419bc90700 1 -- 172.21.15.26:0/1843156749 shutdown_connections 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.178+0000 7f419bc90700 1 -- 172.21.15.26:0/1843156749 wait complete. 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.179+0000 7f419bc90700 1 Processor -- start 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.179+0000 7f419bc90700 1 -- start start 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.179+0000 7f419bc90700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41940aed90 0x7f41940c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.179+0000 7f419bc90700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940ca370 0x7f41940c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.179+0000 7f419bc90700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 0x7f4194151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419bc90700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41941e2c50 con 0x7f41940ceae0 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419bc90700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940c7a80 con 0x7f41940aed90 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419bc90700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41940c77a0 con 0x7f41940ca370 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 0x7f4194151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 0x7f4194151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39904/0 (socket says 172.21.15.26:39904) 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 -- 172.21.15.26:0/3916116126 learned_addr learned my addr 172.21.15.26:0/3916116126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f4199a2c700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41940aed90 0x7f41940c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419922b700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940ca370 0x7f41940c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 -- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940ca370 msgr2=0x7f41940c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940ca370 0x7f41940c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 -- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41940aed90 msgr2=0x7f41940c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41940aed90 0x7f41940c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 -- 172.21.15.26:0/3916116126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190009550 con 0x7f41940ceae0 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419a22d700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 0x7f4194151b30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f418c00efc0 tx=0x7f418c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c009ea0 con 0x7f41940ceae0 2023-06-09T04:39:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00f040 con 0x7f41940ceae0 2023-06-09T04:39:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41941e2600 con 0x7f41940ceae0 2023-06-09T04:39:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00ced0 con 0x7f41940ceae0 2023-06-09T04:39:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.180+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41941e3730 con 0x7f41940ceae0 2023-06-09T04:39:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.181+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41941e2dc0 con 0x7f41940ceae0 2023-06-09T04:39:17.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.182+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f418c014480 con 0x7f41940ceae0 2023-06-09T04:39:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.182+0000 7f418a7fc700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f417806ace0 0x7f417806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.182+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f418c089930 con 0x7f41940ceae0 2023-06-09T04:39:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.182+0000 7f4199a2c700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f417806ace0 0x7f417806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.183+0000 7f4199a2c700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f417806ace0 0x7f417806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4184009aa0 tx=0x7f41840091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.187+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f418c054d30 con 0x7f41940ceae0 2023-06-09T04:39:17.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.466+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4194067180 con 0x7f41940ceae0 2023-06-09T04:39:17.470 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.469+0000 7f418a7fc700 1 -- 172.21.15.26:0/3916116126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f418c058350 con 0x7f41940ceae0 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f417806ace0 msgr2=0x7f417806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f417806ace0 0x7f417806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4184009aa0 tx=0x7f41840091c0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 msgr2=0x7f4194151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 0x7f4194151b30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f418c00efc0 tx=0x7f418c00c3a0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 shutdown_connections 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f417806ace0 0x7f417806d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41940ceae0 0x7f4194151b30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41940aed90 0x7f41940c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 --2- 172.21.15.26:0/3916116126 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f41940ca370 0x7f41940c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.471+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 >> 172.21.15.26:0/3916116126 conn(0x7f4194098a30 msgr2=0x7f41940cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.472+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 shutdown_connections 2023-06-09T04:39:17.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.472+0000 7f419bc90700 1 -- 172.21.15.26:0/3916116126 wait complete. 2023-06-09T04:39:17.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.608+0000 7f4f950e8700 1 Processor -- start 2023-06-09T04:39:17.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.608+0000 7f4f950e8700 1 -- start start 2023-06-09T04:39:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f950e8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f9015c550 0x7f4f90160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f950e8700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900cc620 0x7f4f900caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f950e8700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f900cce70 con 0x7f4f900d0740 2023-06-09T04:39:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f950e8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f90161030 con 0x7f4f9015c550 2023-06-09T04:39:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f950e8700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90160790 con 0x7f4f900cc620 2023-06-09T04:39:17.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f9015c550 0x7f4f90160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8ed9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4f9015c550 0x7f4f90160100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39908/0 (socket says 172.21.15.26:39908) 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/813265744 learned_addr learned my addr 172.21.15.26:0/813265744 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8e59c700 1 --2- 172.21.15.26:0/813265744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900cc620 0x7f4f900caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/813265744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900cc620 msgr2=0x7f4f900caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8ed9d700 1 --2- 172.21.15.26:0/813265744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900cc620 0x7f4f900caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.609+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/813265744 >> v1:172.21.15.104:6789/0 conn(0x7f4f900d0740 legacy=0x7f4f900d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/813265744 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90160a70 con 0x7f4f9015c550 2023-06-09T04:39:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f8ed9d700 1 --2- 172.21.15.26:0/813265744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f9015c550 0x7f4f90160100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006fd0 tx=0x7f4f80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f243067353b0c286 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f8dd9b700 1 -- 172.21.15.26:0/813265744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80005e30 con 0x7f4f9015c550 2023-06-09T04:39:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f8dd9b700 1 -- 172.21.15.26:0/813265744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80006030 con 0x7f4f9015c550 2023-06-09T04:39:17.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f8dd9b700 1 -- 172.21.15.26:0/813265744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800063c0 con 0x7f4f9015c550 2023-06-09T04:39:17.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 -- 172.21.15.26:0/813265744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f9015c550 msgr2=0x7f4f90160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 --2- 172.21.15.26:0/813265744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f9015c550 0x7f4f90160100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006fd0 tx=0x7f4f80009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 -- 172.21.15.26:0/813265744 shutdown_connections 2023-06-09T04:39:17.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 --2- 172.21.15.26:0/813265744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f9015c550 0x7f4f90160100 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 --2- 172.21.15.26:0/813265744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900cc620 0x7f4f900caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 -- 172.21.15.26:0/813265744 >> 172.21.15.26:0/813265744 conn(0x7f4f90089fc0 msgr2=0x7f4f9008a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 -- 172.21.15.26:0/813265744 shutdown_connections 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.610+0000 7f4f950e8700 1 -- 172.21.15.26:0/813265744 wait complete. 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.612+0000 7f4f950e8700 1 Processor -- start 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.612+0000 7f4f950e8700 1 -- start start 2023-06-09T04:39:17.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f950e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 0x7f4f901e5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f950e8700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900d0740 0x7f4f901e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f950e8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9015c550 0x7f4f900af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f950e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b4810 con 0x7f4f900cc620 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f950e8700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c6cc0 con 0x7f4f9015c550 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f950e8700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3ee0 con 0x7f4f900d0740 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 0x7f4f901e5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 0x7f4f901e5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39914/0 (socket says 172.21.15.26:39914) 2023-06-09T04:39:17.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/386687071 learned_addr learned my addr 172.21.15.26:0/386687071 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8e59c700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900d0740 0x7f4f901e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8f59e700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9015c550 0x7f4f900af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900d0740 msgr2=0x7f4f901e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900d0740 0x7f4f901e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9015c550 msgr2=0x7f4f900af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9015c550 0x7f4f900af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 -- 172.21.15.26:0/386687071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009500 con 0x7f4f900cc620 2023-06-09T04:39:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.613+0000 7f4f8ed9d700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 0x7f4f901e5f00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f80012000 tx=0x7f4f80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.614+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80025430 con 0x7f4f900cc620 2023-06-09T04:39:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.614+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80020070 con 0x7f4f900cc620 2023-06-09T04:39:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.614+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900b41c0 con 0x7f4f900cc620 2023-06-09T04:39:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.614+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800257d0 con 0x7f4f900cc620 2023-06-09T04:39:17.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.614+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900af9d0 con 0x7f4f900cc620 2023-06-09T04:39:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.615+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f900b1db0 con 0x7f4f900cc620 2023-06-09T04:39:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.615+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f80022030 con 0x7f4f900cc620 2023-06-09T04:39:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.615+0000 7f4f777fe700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4f7c06ace0 0x7f4f7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.616+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f8008a7f0 con 0x7f4f900cc620 2023-06-09T04:39:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.616+0000 7f4f8e59c700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4f7c06ace0 0x7f4f7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.616+0000 7f4f8e59c700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4f7c06ace0 0x7f4f7c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ced50 tx=0x7f4f84008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.620+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f80055c80 con 0x7f4f900cc620 2023-06-09T04:39:17.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:17.813 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:17.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.819+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f900d14e0 con 0x7f4f900cc620 2023-06-09T04:39:17.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.820+0000 7f4f777fe700 1 -- 172.21.15.26:0/386687071 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14569 (secure 0 0 0) 0x7f4f800592a0 con 0x7f4f900cc620 2023-06-09T04:39:17.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:17.821 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:39:14.398179+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4f7c06ace0 msgr2=0x7f4f7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4f7c06ace0 0x7f4f7c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ced50 tx=0x7f4f84008040 comp rx=0 tx=0).stop 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 msgr2=0x7f4f901e5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 0x7f4f901e5f00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f80012000 tx=0x7f4f80004750 comp rx=0 tx=0).stop 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 shutdown_connections 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9015c550 0x7f4f900af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f4f7c06ace0 0x7f4f7c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f900cc620 0x7f4f901e5f00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 --2- 172.21.15.26:0/386687071 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f900d0740 0x7f4f901e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 >> 172.21.15.26:0/386687071 conn(0x7f4f90089fc0 msgr2=0x7f4f9006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 shutdown_connections 2023-06-09T04:39:17.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:17.822+0000 7f4f950e8700 1 -- 172.21.15.26:0/386687071 wait complete. 2023-06-09T04:39:17.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:03.559240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:38:03.929804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:39:17.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:18.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.033+0000 7f23ce812700 1 Processor -- start 2023-06-09T04:39:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.033+0000 7f23ce812700 1 -- start start 2023-06-09T04:39:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.034+0000 7f23ce812700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23c815a5b0 0x7f23c815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.034+0000 7f23ce812700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c815ae10 con 0x7f23c80b1240 2023-06-09T04:39:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.034+0000 7f23ce812700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c80aeff0 con 0x7f23c80ce520 2023-06-09T04:39:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.034+0000 7f23ce812700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80b1d00 con 0x7f23c815a5b0 2023-06-09T04:39:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.034+0000 7f23ccdaf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f23c80b1240 0x7f23c815dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48784/0 (socket says 172.21.15.26:48784) 2023-06-09T04:39:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.034+0000 7f23ccdaf700 1 -- 172.21.15.26:0/1476789665 learned_addr learned my addr 172.21.15.26:0/1476789665 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c77fe700 1 --2- 172.21.15.26:0/1476789665 >> v2:172.21.15.104:3300/0 conn(0x7f23c815a5b0 0x7f23c815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894511855 0 0) 0x7f23c815ae10 con 0x7f23c80b1240 2023-06-09T04:39:18.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23b40035b0 con 0x7f23c80b1240 2023-06-09T04:39:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 542755843 0 0) 0x7f23b40035b0 con 0x7f23c80b1240 2023-06-09T04:39:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 >> v2:172.21.15.104:3300/0 conn(0x7f23c815a5b0 msgr2=0x7f23c815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/1476789665 >> v2:172.21.15.104:3300/0 conn(0x7f23c815a5b0 0x7f23c815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 >> v1:172.21.15.104:6789/0 conn(0x7f23c80ce520 legacy=0x7f23c80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80b1fe0 con 0x7f23c80b1240 2023-06-09T04:39:18.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7f23c00019f0 con 0x7f23c80b1240 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 >> v1:172.21.15.26:6789/0 conn(0x7f23c80b1240 legacy=0x7f23c815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23b4003a00 0x7f23b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b4004850 0x7f23b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4005200 0x7f23b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80b1d00 con 0x7f23b4003a00 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b400c110 con 0x7f23b4004850 2023-06-09T04:39:18.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b400c2d0 con 0x7f23b4005200 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c7fff700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23b4003a00 0x7f23b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c77fe700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b4004850 0x7f23b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23ccdaf700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4005200 0x7f23b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c7fff700 1 -- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4005200 msgr2=0x7f23b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c7fff700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4005200 0x7f23b400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c7fff700 1 -- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b4004850 msgr2=0x7f23b4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c7fff700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23b4004850 0x7f23b4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23c7fff700 1 -- 172.21.15.26:0/1476789665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40035b0 con 0x7f23b4003a00 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.035+0000 7f23ccdaf700 1 -- 172.21.15.26:0/1476789665 reap_dead start 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23c7fff700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23b4003a00 0x7f23b4003e10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001820 tx=0x7f23b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcdc8549f02ee0a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b80012e0 con 0x7f23b4003a00 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b80052d0 con 0x7f23b4003a00 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23c6ffd700 1 -- 172.21.15.26:0/1476789665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b80036d0 con 0x7f23b4003a00 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 -- 172.21.15.26:0/1476789665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23b4003a00 msgr2=0x7f23b4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23b4003a00 0x7f23b4003e10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001820 tx=0x7f23b4005880 comp rx=0 tx=0).stop 2023-06-09T04:39:18.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 -- 172.21.15.26:0/1476789665 shutdown_connections 2023-06-09T04:39:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 --2- 172.21.15.26:0/1476789665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23b4003a00 0x7f23b4003e10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 -- 172.21.15.26:0/1476789665 >> 172.21.15.26:0/1476789665 conn(0x7f23c8098b50 msgr2=0x7f23c80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 -- 172.21.15.26:0/1476789665 shutdown_connections 2023-06-09T04:39:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.036+0000 7f23ce812700 1 -- 172.21.15.26:0/1476789665 wait complete. 2023-06-09T04:39:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 Processor -- start 2023-06-09T04:39:18.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 -- start start 2023-06-09T04:39:18.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4003a00 0x7f23c80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23c80b3000 0x7f23c8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 0x7f23c80c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80b41f0 con 0x7f23c8151c20 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80b4b50 con 0x7f23c80b3000 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.038+0000 7f23ce812700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80b3570 con 0x7f23b4003a00 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 0x7f23c80c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 0x7f23c80c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39936/0 (socket says 172.21.15.26:39936) 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 -- 172.21.15.26:0/3991299317 learned_addr learned my addr 172.21.15.26:0/3991299317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23c77fe700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23c80b3000 0x7f23c8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23c7fff700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4003a00 0x7f23c80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 -- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4003a00 msgr2=0x7f23c80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4003a00 0x7f23c80b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 -- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23c80b3000 msgr2=0x7f23c8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23c80b3000 0x7f23c8145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 -- 172.21.15.26:0/3991299317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80b3850 con 0x7f23c8151c20 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23c7fff700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4003a00 0x7f23c80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:18.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ccdaf700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 0x7f23c80c79c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f23c8066560 tx=0x7f23c000e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000ecc0 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000ee20 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0013640 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c80b3b30 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.039+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8145fd0 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.040+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c8067180 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.041+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23c00137a0 con 0x7f23c8151c20 2023-06-09T04:39:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.041+0000 7f23c4ff9700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23a806ace0 0x7f23a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.041+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f23c00896f0 con 0x7f23c8151c20 2023-06-09T04:39:18.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.042+0000 7f23c7fff700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23a806ace0 0x7f23a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.042+0000 7f23c7fff700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23a806ace0 0x7f23a806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005040 tx=0x7f23b8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.046+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23c0054af0 con 0x7f23c8151c20 2023-06-09T04:39:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.242+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23c8071ec0 con 0x7f23c8151c20 2023-06-09T04:39:18.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.242+0000 7f23c4ff9700 1 -- 172.21.15.26:0/3991299317 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23c0058110 con 0x7f23c8151c20 2023-06-09T04:39:18.244 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23a806ace0 msgr2=0x7f23a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23a806ace0 0x7f23a806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005040 tx=0x7f23b8009030 comp rx=0 tx=0).stop 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 msgr2=0x7f23c80c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 0x7f23c80c79c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f23c8066560 tx=0x7f23c000e4f0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 shutdown_connections 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23a806ace0 0x7f23a806d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23c8151c20 0x7f23c80c79c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23b4003a00 0x7f23c80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 --2- 172.21.15.26:0/3991299317 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23c80b3000 0x7f23c8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.244+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 >> 172.21.15.26:0/3991299317 conn(0x7f23c8098b50 msgr2=0x7f23c8155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.245+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 shutdown_connections 2023-06-09T04:39:18.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.245+0000 7f23ce812700 1 -- 172.21.15.26:0/3991299317 wait complete. 2023-06-09T04:39:18.258 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:18.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.385+0000 7fe4f1623700 1 Processor -- start 2023-06-09T04:39:18.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.385+0000 7fe4f1623700 1 -- start start 2023-06-09T04:39:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4f1623700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe4ec06a4c0 0x7fe4ec0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4f1623700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec158dd0 con 0x7fe4ec158a00 2023-06-09T04:39:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4f1623700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec06c3c0 con 0x7fe4ec0ccbd0 2023-06-09T04:39:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4f1623700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec06a8c0 con 0x7fe4ec06a4c0 2023-06-09T04:39:18.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4eaffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe4ec158a00 0x7fe4ec0c9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48798/0 (socket says 172.21.15.26:48798) 2023-06-09T04:39:18.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4eaffd700 1 -- 172.21.15.26:0/1661953826 learned_addr learned my addr 172.21.15.26:0/1661953826 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:18.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4eb7fe700 1 --2- 172.21.15.26:0/1661953826 >> v2:172.21.15.104:3300/0 conn(0x7fe4ec06a4c0 0x7fe4ec0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4e9ffb700 1 -- 172.21.15.26:0/1661953826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637228955 0 0) 0x7fe4ec158dd0 con 0x7fe4ec158a00 2023-06-09T04:39:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4e9ffb700 1 -- 172.21.15.26:0/1661953826 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d40035b0 con 0x7fe4ec158a00 2023-06-09T04:39:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1661953826 >> v1:172.21.15.104:6789/0 conn(0x7fe4ec0ccbd0 legacy=0x7fe4ec069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4e9ffb700 1 -- 172.21.15.26:0/1661953826 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967181332 0 0) 0x7fe4ec06c3c0 con 0x7fe4ec0ccbd0 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1661953826 >> v1:172.21.15.26:6789/0 conn(0x7fe4ec158a00 legacy=0x7fe4ec0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.386+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1661953826 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec06c6a0 con 0x7fe4ec06a4c0 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4eb7fe700 1 --2- 172.21.15.26:0/1661953826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec06a4c0 0x7fe4ec0cd050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400aea0 tx=0x7fe4e400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226c30d8d0458eb0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4e9ffb700 1 -- 172.21.15.26:0/1661953826 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400f070 con 0x7fe4ec06a4c0 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4e9ffb700 1 -- 172.21.15.26:0/1661953826 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4003a20 con 0x7fe4ec06a4c0 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4e9ffb700 1 -- 172.21.15.26:0/1661953826 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc001670 con 0x7fe4ec06a4c0 2023-06-09T04:39:18.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 -- 172.21.15.26:0/1661953826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec06a4c0 msgr2=0x7fe4ec0cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1661953826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec06a4c0 0x7fe4ec0cd050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400aea0 tx=0x7fe4e400c330 comp rx=0 tx=0).stop 2023-06-09T04:39:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 -- 172.21.15.26:0/1661953826 shutdown_connections 2023-06-09T04:39:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1661953826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec06a4c0 0x7fe4ec0cd050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 -- 172.21.15.26:0/1661953826 >> 172.21.15.26:0/1661953826 conn(0x7fe4ec0b0f10 msgr2=0x7fe4ec0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 -- 172.21.15.26:0/1661953826 shutdown_connections 2023-06-09T04:39:18.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.387+0000 7fe4f1623700 1 -- 172.21.15.26:0/1661953826 wait complete. 2023-06-09T04:39:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 Processor -- start 2023-06-09T04:39:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 -- start start 2023-06-09T04:39:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe4ec06a4c0 0x7fe4ec152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec0ccbd0 0x7fe4ec0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 0x7fe4ec0701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c4310 con 0x7fe4ec158a00 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec153210 con 0x7fe4ec0ccbd0 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.389+0000 7fe4f1623700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c3790 con 0x7fe4ec06a4c0 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 0x7fe4ec0701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 0x7fe4ec0701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39950/0 (socket says 172.21.15.26:39950) 2023-06-09T04:39:18.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1314141823 learned_addr learned my addr 172.21.15.26:0/1314141823 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe4ec06a4c0 msgr2=0x7fe4ec152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe4ec06a4c0 0x7fe4ec152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec0ccbd0 msgr2=0x7fe4ec0c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4ea7fc700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec0ccbd0 0x7fe4ec0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec0ccbd0 0x7fe4ec0c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 -- 172.21.15.26:0/1314141823 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e400ab80 con 0x7fe4ec158a00 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4eb7fe700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 0x7fe4ec0701c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400a1b0 tx=0x7fe4e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4004440 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e401f070 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0c3a70 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40047c0 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.390+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0c4030 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.391+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec0cddb0 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.392+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4e401a450 con 0x7fe4ec158a00 2023-06-09T04:39:18.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.392+0000 7fe4d37fe700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe4d806ace0 0x7fe4d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.392+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe4e4021070 con 0x7fe4ec158a00 2023-06-09T04:39:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.392+0000 7fe4eaffd700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe4d806ace0 0x7fe4d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.393+0000 7fe4eaffd700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe4d806ace0 0x7fe4d806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0011e0 tx=0x7fe4dc001170 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.397+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4e4057810 con 0x7fe4ec158a00 2023-06-09T04:39:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.595+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4ec074080 con 0x7fe4ec158a00 2023-06-09T04:39:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.595+0000 7fe4d37fe700 1 -- 172.21.15.26:0/1314141823 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4e402a020 con 0x7fe4ec158a00 2023-06-09T04:39:18.597 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-06-09T04:39:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe4d806ace0 msgr2=0x7fe4d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe4d806ace0 0x7fe4d806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0011e0 tx=0x7fe4dc001170 comp rx=0 tx=0).stop 2023-06-09T04:39:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 msgr2=0x7fe4ec0701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 0x7fe4ec0701c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400a1b0 tx=0x7fe4e4004ad0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 shutdown_connections 2023-06-09T04:39:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fe4d806ace0 0x7fe4d806d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4ec158a00 0x7fe4ec0701c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe4ec06a4c0 0x7fe4ec152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 --2- 172.21.15.26:0/1314141823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4ec0ccbd0 0x7fe4ec0c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 >> 172.21.15.26:0/1314141823 conn(0x7fe4ec0b0f10 msgr2=0x7fe4ec156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 shutdown_connections 2023-06-09T04:39:18.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.597+0000 7fe4f1623700 1 -- 172.21.15.26:0/1314141823 wait complete. 2023-06-09T04:39:18.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:39:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.734+0000 7f5b57cbf700 1 Processor -- start 2023-06-09T04:39:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.734+0000 7f5b57cbf700 1 -- start start 2023-06-09T04:39:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b57cbf700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b5015d780 0x7f5b500b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b57cbf700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5b500b07c0 0x7f5b500cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b57cbf700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b500cc0f0 con 0x7f5b500caf70 2023-06-09T04:39:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b57cbf700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b500b00a0 con 0x7f5b5015d780 2023-06-09T04:39:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b57cbf700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b500cfc20 con 0x7f5b500b07c0 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b55a5b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b5015d780 0x7f5b500b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b5625c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5b500caf70 0x7f5b500ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48816/0 (socket says 172.21.15.26:48816) 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b5625c700 1 -- 172.21.15.26:0/2304678180 learned_addr learned my addr 172.21.15.26:0/2304678180 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.735+0000 7f5b5525a700 1 --2- 172.21.15.26:0/2304678180 >> v2:172.21.15.104:3300/0 conn(0x7f5b500b07c0 0x7f5b500cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b55a5b700 1 -- 172.21.15.26:0/2304678180 >> v2:172.21.15.104:3300/0 conn(0x7f5b500b07c0 msgr2=0x7f5b500cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b55a5b700 1 --2- 172.21.15.26:0/2304678180 >> v2:172.21.15.104:3300/0 conn(0x7f5b500b07c0 0x7f5b500cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b55a5b700 1 -- 172.21.15.26:0/2304678180 >> v1:172.21.15.26:6789/0 conn(0x7f5b500caf70 legacy=0x7f5b500ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b54a59700 1 -- 172.21.15.26:0/2304678180 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027918210 0 0) 0x7f5b500cc0f0 con 0x7f5b500caf70 2023-06-09T04:39:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b55a5b700 1 -- 172.21.15.26:0/2304678180 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b500cb4e0 con 0x7f5b5015d780 2023-06-09T04:39:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b55a5b700 1 --2- 172.21.15.26:0/2304678180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b5015d780 0x7f5b500b0280 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5b500d01f0 tx=0x7f5b4c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4dc9e09acb4246 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b54a59700 1 -- 172.21.15.26:0/2304678180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c005e30 con 0x7f5b5015d780 2023-06-09T04:39:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b54a59700 1 -- 172.21.15.26:0/2304678180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c006030 con 0x7f5b5015d780 2023-06-09T04:39:18.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b54a59700 1 -- 172.21.15.26:0/2304678180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0063c0 con 0x7f5b5015d780 2023-06-09T04:39:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b57cbf700 1 -- 172.21.15.26:0/2304678180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b5015d780 msgr2=0x7f5b500b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.736+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/2304678180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b5015d780 0x7f5b500b0280 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5b500d01f0 tx=0x7f5b4c009b00 comp rx=0 tx=0).stop 2023-06-09T04:39:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.737+0000 7f5b57cbf700 1 -- 172.21.15.26:0/2304678180 shutdown_connections 2023-06-09T04:39:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.737+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/2304678180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b5015d780 0x7f5b500b0280 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.737+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/2304678180 >> v2:172.21.15.104:3300/0 conn(0x7f5b500b07c0 0x7f5b500cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.737+0000 7f5b57cbf700 1 -- 172.21.15.26:0/2304678180 >> 172.21.15.26:0/2304678180 conn(0x7f5b50089fc0 msgr2=0x7f5b500d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.737+0000 7f5b57cbf700 1 -- 172.21.15.26:0/2304678180 shutdown_connections 2023-06-09T04:39:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.737+0000 7f5b57cbf700 1 -- 172.21.15.26:0/2304678180 wait complete. 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.738+0000 7f5b57cbf700 1 Processor -- start 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.738+0000 7f5b57cbf700 1 -- start start 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5b500b07c0 0x7f5b50159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 0x7f5b50159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b5015d780 0x7f5b500c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500b4a70 con 0x7f5b500caf70 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500b4cc0 con 0x7f5b5015d780 2023-06-09T04:39:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500b4fa0 con 0x7f5b500b07c0 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 0x7f5b50159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 0x7f5b50159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39962/0 (socket says 172.21.15.26:39962) 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 -- 172.21.15.26:0/426725538 learned_addr learned my addr 172.21.15.26:0/426725538 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5625c700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b5015d780 0x7f5b500c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b55a5b700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5b500b07c0 0x7f5b50159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 -- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5b500b07c0 msgr2=0x7f5b50159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5b500b07c0 0x7f5b50159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 -- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b5015d780 msgr2=0x7f5b500c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b5015d780 0x7f5b500c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 -- 172.21.15.26:0/426725538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c009430 con 0x7f5b500caf70 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b55a5b700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5b500b07c0 0x7f5b50159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5625c700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b5015d780 0x7f5b500c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b5525a700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 0x7f5b50159260 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000e850 tx=0x7f5b4000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400095b0 con 0x7f5b500caf70 2023-06-09T04:39:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4000ee50 con 0x7f5b500caf70 2023-06-09T04:39:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b500b5280 con 0x7f5b500caf70 2023-06-09T04:39:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000ca70 con 0x7f5b500caf70 2023-06-09T04:39:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.739+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b50159ff0 con 0x7f5b500caf70 2023-06-09T04:39:18.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.740+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b500b57a0 con 0x7f5b500caf70 2023-06-09T04:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.741+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b4000cbd0 con 0x7f5b500caf70 2023-06-09T04:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.741+0000 7f5b467fc700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5b3406ace0 0x7f5b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.741+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5b400890b0 con 0x7f5b500caf70 2023-06-09T04:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.741+0000 7f5b55a5b700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5b3406ace0 0x7f5b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.742+0000 7f5b55a5b700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5b3406ace0 0x7f5b3406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c013040 tx=0x7f5b4c008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.746+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b500b57a0 con 0x7f5b500caf70 2023-06-09T04:39:18.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.946+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b500b57a0 con 0x7f5b500caf70 2023-06-09T04:39:18.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.946+0000 7f5b467fc700 1 -- 172.21.15.26:0/426725538 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5b500b57a0 con 0x7f5b500caf70 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "rbd" 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:18.948 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-06-09T04:39:18.949 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 2, 2023-06-09T04:39:18.949 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-06-09T04:39:18.949 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:18.949 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-06-09T04:39:18.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5b3406ace0 msgr2=0x7f5b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5b3406ace0 0x7f5b3406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c013040 tx=0x7f5b4c008070 comp rx=0 tx=0).stop 2023-06-09T04:39:18.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 msgr2=0x7f5b50159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 0x7f5b50159260 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000e850 tx=0x7f5b4000ec10 comp rx=0 tx=0).stop 2023-06-09T04:39:18.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 shutdown_connections 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b5015d780 0x7f5b500c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5b500b07c0 0x7f5b50159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f5b3406ace0 0x7f5b3406d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 --2- 172.21.15.26:0/426725538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b500caf70 0x7f5b50159260 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 >> 172.21.15.26:0/426725538 conn(0x7f5b50089fc0 msgr2=0x7f5b500b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 shutdown_connections 2023-06-09T04:39:18.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:18.948+0000 7f5b57cbf700 1 -- 172.21.15.26:0/426725538 wait complete. 2023-06-09T04:39:18.961 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:39:18.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:39:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.089+0000 7ff9b316d700 1 Processor -- start 2023-06-09T04:39:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.089+0000 7ff9b316d700 1 -- start start 2023-06-09T04:39:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b316d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9ac15a2a0 0x7ff9ac0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b316d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac0ceb00 0x7ff9ac0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b316d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0b31f0 con 0x7ff9ac0cd800 2023-06-09T04:39:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b316d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0cdc70 con 0x7ff9ac15a2a0 2023-06-09T04:39:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b316d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0caf10 con 0x7ff9ac0ceb00 2023-06-09T04:39:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b0f09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9ac15a2a0 0x7ff9ac0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b0f09700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9ac15a2a0 0x7ff9ac0cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39968/0 (socket says 172.21.15.26:39968) 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1377947761 learned_addr learned my addr 172.21.15.26:0/1377947761 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b170a700 1 --2- 172.21.15.26:0/1377947761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac0ceb00 0x7ff9ac0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1377947761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac0ceb00 msgr2=0x7ff9ac0cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b0f09700 1 --2- 172.21.15.26:0/1377947761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac0ceb00 0x7ff9ac0cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.090+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1377947761 >> v1:172.21.15.104:6789/0 conn(0x7ff9ac0cd800 legacy=0x7ff9ac0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1377947761 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0cb180 con 0x7ff9ac15a2a0 2023-06-09T04:39:19.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b0f09700 1 --2- 172.21.15.26:0/1377947761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac15a2a0 0x7ff9ac0cd2c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0006fd0 tx=0x7ff9a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631894f039538b44 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9ab7fe700 1 -- 172.21.15.26:0/1377947761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0005e30 con 0x7ff9ac15a2a0 2023-06-09T04:39:19.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9ab7fe700 1 -- 172.21.15.26:0/1377947761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0004030 con 0x7ff9ac15a2a0 2023-06-09T04:39:19.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9ab7fe700 1 -- 172.21.15.26:0/1377947761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00043e0 con 0x7ff9ac15a2a0 2023-06-09T04:39:19.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 -- 172.21.15.26:0/1377947761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac15a2a0 msgr2=0x7ff9ac0cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1377947761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac15a2a0 0x7ff9ac0cd2c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0006fd0 tx=0x7ff9a0009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 -- 172.21.15.26:0/1377947761 shutdown_connections 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1377947761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac0ceb00 0x7ff9ac0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1377947761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac15a2a0 0x7ff9ac0cd2c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 -- 172.21.15.26:0/1377947761 >> 172.21.15.26:0/1377947761 conn(0x7ff9ac06a6d0 msgr2=0x7ff9ac099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.091+0000 7ff9b316d700 1 -- 172.21.15.26:0/1377947761 shutdown_connections 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.092+0000 7ff9b316d700 1 -- 172.21.15.26:0/1377947761 wait complete. 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.093+0000 7ff9b316d700 1 Processor -- start 2023-06-09T04:39:19.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.093+0000 7ff9b316d700 1 -- start start 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 0x7ff9ac155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9ac0ceb00 0x7ff9ac0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac15a2a0 0x7ff9ac0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c9920 con 0x7ff9ac0cd800 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c8ce0 con 0x7ff9ac0ceb00 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c8f80 con 0x7ff9ac15a2a0 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 0x7ff9ac155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 0x7ff9ac155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39974/0 (socket says 172.21.15.26:39974) 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1003975858 learned_addr learned my addr 172.21.15.26:0/1003975858 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac15a2a0 msgr2=0x7ff9ac0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b170a700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac15a2a0 0x7ff9ac0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9abfff700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9ac0ceb00 0x7ff9ac0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac15a2a0 0x7ff9ac0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9ac0ceb00 msgr2=0x7ff9ac0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9ac0ceb00 0x7ff9ac0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 -- 172.21.15.26:0/1003975858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009500 con 0x7ff9ac0cd800 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b170a700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac15a2a0 0x7ff9ac0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9abfff700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9ac0ceb00 0x7ff9ac0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b0f09700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 0x7ff9ac155700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c10 tx=0x7ff9a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0003dd0 con 0x7ff9ac0cd800 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a001c420 con 0x7ff9ac0cd800 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0c9260 con 0x7ff9ac0cd800 2023-06-09T04:39:19.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.094+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a001c7b0 con 0x7ff9ac0cd800 2023-06-09T04:39:19.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.095+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac155c40 con 0x7ff9ac0cd800 2023-06-09T04:39:19.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.095+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac0c9a60 con 0x7ff9ac0cd800 2023-06-09T04:39:19.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.096+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9a001c910 con 0x7ff9ac0cd800 2023-06-09T04:39:19.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.096+0000 7ff9a97fa700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff99006ace0 0x7ff99006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.096+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff9a008a280 con 0x7ff9ac0cd800 2023-06-09T04:39:19.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.097+0000 7ff9abfff700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff99006ace0 0x7ff99006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.097+0000 7ff9abfff700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff99006ace0 0x7ff99006d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b59a0 tx=0x7ff998009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.101+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff9ac0c9a60 con 0x7ff9ac0cd800 2023-06-09T04:39:19.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:19.298+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff9ac0c9a60 con 0x7ff9ac0cd800 2023-06-09T04:39:20.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.220+0000 7ff9a97fa700 1 -- 172.21.15.26:0/1003975858 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff9ac0c9a60 con 0x7ff9ac0cd800 2023-06-09T04:39:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.224+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff99006ace0 msgr2=0x7ff99006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.224+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff99006ace0 0x7ff99006d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0b59a0 tx=0x7ff998009040 comp rx=0 tx=0).stop 2023-06-09T04:39:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.224+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 msgr2=0x7ff9ac155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.224+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 0x7ff9ac155700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c10 tx=0x7ff9a0004750 comp rx=0 tx=0).stop 2023-06-09T04:39:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.225+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 shutdown_connections 2023-06-09T04:39:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.225+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9ac15a2a0 0x7ff9ac0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.225+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff99006ace0 0x7ff99006d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.225+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9ac0cd800 0x7ff9ac155700 secure :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c10 tx=0x7ff9a0004750 comp rx=0 tx=0).stop 2023-06-09T04:39:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.225+0000 7ff9b316d700 1 --2- 172.21.15.26:0/1003975858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9ac0ceb00 0x7ff9ac0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.225+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 >> 172.21.15.26:0/1003975858 conn(0x7ff9ac06a6d0 msgr2=0x7ff9ac159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.226+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 shutdown_connections 2023-06-09T04:39:20.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.226+0000 7ff9b316d700 1 -- 172.21.15.26:0/1003975858 wait complete. 2023-06-09T04:39:20.228 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-06-09T04:39:20.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:39:20.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.379+0000 7fad4e22b700 1 Processor -- start 2023-06-09T04:39:20.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad4e22b700 1 -- start start 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad4e22b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fad480b0240 0x7fad480cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad4e22b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480b0740 con 0x7fad480d1270 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad4e22b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480b0a20 con 0x7fad480ce6c0 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad4e22b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815c9a0 con 0x7fad480b0240 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad46ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fad480d1270 0x7fad480caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48842/0 (socket says 172.21.15.26:48842) 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.380+0000 7fad46ffd700 1 -- 172.21.15.26:0/1728870133 learned_addr learned my addr 172.21.15.26:0/1728870133 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:20.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad47fff700 1 --2- 172.21.15.26:0/1728870133 >> v2:172.21.15.104:3300/0 conn(0x7fad480b0240 0x7fad480cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101145665 0 0) 0x7fad480b0740 con 0x7fad480d1270 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad340035b0 con 0x7fad480d1270 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715557217 0 0) 0x7fad340035b0 con 0x7fad480d1270 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 >> v2:172.21.15.104:3300/0 conn(0x7fad480b0240 msgr2=0x7fad480cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 --2- 172.21.15.26:0/1728870133 >> v2:172.21.15.104:3300/0 conn(0x7fad480b0240 0x7fad480cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 >> v1:172.21.15.104:6789/0 conn(0x7fad480ce6c0 legacy=0x7fad480cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480b0d00 con 0x7fad480d1270 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7fad38001670 con 0x7fad480d1270 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 >> v1:172.21.15.26:6789/0 conn(0x7fad480d1270 legacy=0x7fad480caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad34003a00 0x7fad34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34004850 0x7fad34004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34005200 0x7fad3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815c9a0 con 0x7fad34005200 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3400c110 con 0x7fad34003a00 2023-06-09T04:39:20.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3400c2d0 con 0x7fad34004850 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad47fff700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34005200 0x7fad3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad477fe700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad34003a00 0x7fad34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.381+0000 7fad46ffd700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34004850 0x7fad34004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 -- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34004850 msgr2=0x7fad34004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34004850 0x7fad34004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 -- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad34003a00 msgr2=0x7fad34003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad34003a00 0x7fad34003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 -- 172.21.15.26:0/1728870133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340035b0 con 0x7fad34005200 2023-06-09T04:39:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad477fe700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad34003a00 0x7fad34003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 -- 172.21.15.26:0/1728870133 reap_dead start 2023-06-09T04:39:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad47fff700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34005200 0x7fad3400ba10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fc0 tx=0x7fad34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9675b7d83b1d53f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40003a20 con 0x7fad34005200 2023-06-09T04:39:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000f040 con 0x7fad34005200 2023-06-09T04:39:20.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad467fc700 1 -- 172.21.15.26:0/1728870133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40003de0 con 0x7fad34005200 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 -- 172.21.15.26:0/1728870133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34005200 msgr2=0x7fad3400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34005200 0x7fad3400ba10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fc0 tx=0x7fad34005880 comp rx=0 tx=0).stop 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 -- 172.21.15.26:0/1728870133 shutdown_connections 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1728870133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad34005200 0x7fad3400ba10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 -- 172.21.15.26:0/1728870133 >> 172.21.15.26:0/1728870133 conn(0x7fad48089fc0 msgr2=0x7fad4808a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 -- 172.21.15.26:0/1728870133 shutdown_connections 2023-06-09T04:39:20.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.382+0000 7fad4e22b700 1 -- 172.21.15.26:0/1728870133 wait complete. 2023-06-09T04:39:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.384+0000 7fad4e22b700 1 Processor -- start 2023-06-09T04:39:20.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.384+0000 7fad4e22b700 1 -- start start 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34005200 0x7fad48150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 0x7fad480b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad481f5040 0x7fad481f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c63c0 con 0x7fad480b38a0 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481f5a20 con 0x7fad481f5040 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad48150c40 con 0x7fad34005200 2023-06-09T04:39:20.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 0x7fad480b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 0x7fad480b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39996/0 (socket says 172.21.15.26:39996) 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 -- 172.21.15.26:0/1153810982 learned_addr learned my addr 172.21.15.26:0/1153810982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad47fff700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad481f5040 0x7fad481f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad477fe700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34005200 0x7fad48150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 -- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34005200 msgr2=0x7fad48150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34005200 0x7fad48150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 -- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad481f5040 msgr2=0x7fad481f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad481f5040 0x7fad481f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 -- 172.21.15.26:0/1153810982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48151130 con 0x7fad480b38a0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad46ffd700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 0x7fad480b60c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fad38007290 tx=0x7fad38007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800f6c0 con 0x7fad480b38a0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800f820 con 0x7fad480b38a0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480c5460 con 0x7fad480b38a0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800fbb0 con 0x7fad480b38a0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.385+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480c5a20 con 0x7fad480b38a0 2023-06-09T04:39:20.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.386+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad480c6500 con 0x7fad480b38a0 2023-06-09T04:39:20.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.387+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad3800fd10 con 0x7fad480b38a0 2023-06-09T04:39:20.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.387+0000 7fad3ffff700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fad2806ace0 0x7fad2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.387+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fad38089370 con 0x7fad480b38a0 2023-06-09T04:39:20.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.388+0000 7fad477fe700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fad2806ace0 0x7fad2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.388+0000 7fad477fe700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fad2806ace0 0x7fad2806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.392+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fad480c6500 con 0x7fad480b38a0 2023-06-09T04:39:20.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:20.587+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fad480c6500 con 0x7fad480b38a0 2023-06-09T04:39:21.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.223+0000 7fad3ffff700 1 -- 172.21.15.26:0/1153810982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7fad480c6500 con 0x7fad480b38a0 2023-06-09T04:39:21.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fad2806ace0 msgr2=0x7fad2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fad2806ace0 0x7fad2806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30009040 comp rx=0 tx=0).stop 2023-06-09T04:39:21.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 msgr2=0x7fad480b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 0x7fad480b60c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fad38007290 tx=0x7fad38007650 comp rx=0 tx=0).stop 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 shutdown_connections 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad481f5040 0x7fad481f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad34005200 0x7fad48150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fad2806ace0 0x7fad2806d190 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30009040 comp rx=0 tx=0).stop 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 --2- 172.21.15.26:0/1153810982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad480b38a0 0x7fad480b60c0 secure :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fad38007290 tx=0x7fad38007650 comp rx=0 tx=0).stop 2023-06-09T04:39:21.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.229+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 >> 172.21.15.26:0/1153810982 conn(0x7fad48089fc0 msgr2=0x7fad480d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.230+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 shutdown_connections 2023-06-09T04:39:21.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.230+0000 7fad4e22b700 1 -- 172.21.15.26:0/1153810982 wait complete. 2023-06-09T04:39:21.235 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-06-09T04:39:21.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:39:21.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.381+0000 7f93877a4700 1 Processor -- start 2023-06-09T04:39:21.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.381+0000 7f93877a4700 1 -- start start 2023-06-09T04:39:21.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f93877a4700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93800ae920 0x7f938006a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f93877a4700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f938015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f93877a4700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9380069db0 con 0x7f93801604a0 2023-06-09T04:39:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f93877a4700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938006ad40 con 0x7f93800ae920 2023-06-09T04:39:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f93877a4700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93801609b0 con 0x7f93800aecf0 2023-06-09T04:39:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f9384d3f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f938015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f9385540700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93800ae920 0x7f938006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f9384d3f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f938015ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50660/0 (socket says 172.21.15.26:50660) 2023-06-09T04:39:21.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.382+0000 7f9384d3f700 1 -- 172.21.15.26:0/3863535625 learned_addr learned my addr 172.21.15.26:0/3863535625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:21.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9385540700 1 -- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 msgr2=0x7f938015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9385540700 1 --2- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f938015ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9385540700 1 -- 172.21.15.26:0/3863535625 >> v1:172.21.15.104:6789/0 conn(0x7f93801604a0 legacy=0x7f938006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9377fff700 1 -- 172.21.15.26:0/3863535625 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355575081 0 0) 0x7f9380069db0 con 0x7f93801604a0 2023-06-09T04:39:21.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9385540700 1 -- 172.21.15.26:0/3863535625 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380160c90 con 0x7f93800ae920 2023-06-09T04:39:21.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9384d3f700 1 --2- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f938015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:21.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9385540700 1 --2- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93800ae920 0x7f938006a800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9370009820 tx=0x7f9370009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232b9ffefd7c6416 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9377fff700 1 -- 172.21.15.26:0/3863535625 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370005e30 con 0x7f93800ae920 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9377fff700 1 -- 172.21.15.26:0/3863535625 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370006030 con 0x7f93800ae920 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.383+0000 7f9377fff700 1 -- 172.21.15.26:0/3863535625 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93700063c0 con 0x7f93800ae920 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 -- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93800ae920 msgr2=0x7f938006a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 --2- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93800ae920 0x7f938006a800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9370009820 tx=0x7f9370009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 -- 172.21.15.26:0/3863535625 shutdown_connections 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 --2- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93800ae920 0x7f938006a800 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 --2- 172.21.15.26:0/3863535625 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f938015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 -- 172.21.15.26:0/3863535625 >> 172.21.15.26:0/3863535625 conn(0x7f9380098b50 msgr2=0x7f93800cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 -- 172.21.15.26:0/3863535625 shutdown_connections 2023-06-09T04:39:21.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.384+0000 7f93877a4700 1 -- 172.21.15.26:0/3863535625 wait complete. 2023-06-09T04:39:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.385+0000 7f93877a4700 1 Processor -- start 2023-06-09T04:39:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.385+0000 7f93877a4700 1 -- start start 2023-06-09T04:39:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f93877a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 0x7f9380153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f93877a4700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f93800c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f93877a4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93801604a0 0x7f93800cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f93877a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93800c8100 con 0x7f93800ae920 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f93877a4700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93800c83e0 con 0x7f93801604a0 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f93877a4700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93800c86c0 con 0x7f93800aecf0 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 0x7f9380153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 0x7f9380153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40008/0 (socket says 172.21.15.26:40008) 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 -- 172.21.15.26:0/3067584892 learned_addr learned my addr 172.21.15.26:0/3067584892 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9384d3f700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f93800c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385d41700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93801604a0 0x7f93800cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 -- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 msgr2=0x7f93800c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f93800c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 -- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93801604a0 msgr2=0x7f93800cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93801604a0 0x7f93800cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 -- 172.21.15.26:0/3067584892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c009550 con 0x7f93800ae920 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.386+0000 7f9385540700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 0x7f9380153d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9370000c00 tx=0x7f9370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.387+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370006980 con 0x7f93800ae920 2023-06-09T04:39:21.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.387+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370020070 con 0x7f93800ae920 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.387+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370004260 con 0x7f93800ae920 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.387+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9370009430 con 0x7f93800ae920 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.387+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93800c8c80 con 0x7f93800ae920 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.388+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93800b13c0 con 0x7f93800ae920 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.388+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9370022030 con 0x7f93800ae920 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.389+0000 7f9375ffb700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f936406ace0 0x7f936406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.389+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f937008aad0 con 0x7f93800ae920 2023-06-09T04:39:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.389+0000 7f9384d3f700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f936406ace0 0x7f936406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.389+0000 7f9384d3f700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f936406ace0 0x7f936406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f937c006d30 tx=0x7f937c0092c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.394 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.393+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9370055c70 con 0x7f93800ae920 2023-06-09T04:39:21.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.637+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9380067180 con 0x7f93800ae920 2023-06-09T04:39:21.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.642+0000 7f9375ffb700 1 -- 172.21.15.26:0/3067584892 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9370059290 con 0x7f93800ae920 2023-06-09T04:39:21.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f936406ace0 msgr2=0x7f936406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f936406ace0 0x7f936406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f937c006d30 tx=0x7f937c0092c0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 msgr2=0x7f9380153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 0x7f9380153d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9370000c00 tx=0x7f9370004750 comp rx=0 tx=0).stop 2023-06-09T04:39:21.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 shutdown_connections 2023-06-09T04:39:21.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93801604a0 0x7f93800cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f936406ace0 0x7f936406d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93800ae920 0x7f9380153d10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 --2- 172.21.15.26:0/3067584892 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93800aecf0 0x7f93800c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 >> 172.21.15.26:0/3067584892 conn(0x7f9380098b50 msgr2=0x7f93800ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 shutdown_connections 2023-06-09T04:39:21.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.647+0000 7f93877a4700 1 -- 172.21.15.26:0/3067584892 wait complete. 2023-06-09T04:39:21.650 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 5 and data pool 6 2023-06-09T04:39:21.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:21.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.797+0000 7f641738b700 1 Processor -- start 2023-06-09T04:39:21.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.798+0000 7f641738b700 1 -- start start 2023-06-09T04:39:21.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.798+0000 7f641738b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f641015c620 0x7f64100ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.798+0000 7f641738b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 0x7f641006e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.798+0000 7f641738b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64100b2130 con 0x7f641006e8c0 2023-06-09T04:39:21.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.798+0000 7f641738b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64100aef90 con 0x7f641015c620 2023-06-09T04:39:21.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.798+0000 7f641738b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641006a9c0 con 0x7f64100aeb20 2023-06-09T04:39:21.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6414926700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 0x7f641006e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f641015c620 0x7f64100ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f641015c620 0x7f64100ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:47152/0 (socket says 172.21.15.26:47152) 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6414926700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 0x7f641006e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50690/0 (socket says 172.21.15.26:50690) 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 -- 172.21.15.26:0/496051092 learned_addr learned my addr 172.21.15.26:0/496051092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415928700 1 --1- 172.21.15.26:0/496051092 >> v1:172.21.15.104:6789/0 conn(0x7f641006e8c0 0x7f641006cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:47804/0 (socket says 172.21.15.26:47804) 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6407fff700 1 -- 172.21.15.26:0/496051092 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845165154 0 0) 0x7f64100b2130 con 0x7f641006e8c0 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6407fff700 1 -- 172.21.15.26:0/496051092 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63fc0035b0 con 0x7f641006e8c0 2023-06-09T04:39:21.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 -- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 msgr2=0x7f641006e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 --2- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 0x7f641006e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 -- 172.21.15.26:0/496051092 >> v1:172.21.15.104:6789/0 conn(0x7f641006e8c0 legacy=0x7f641006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 -- 172.21.15.26:0/496051092 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100ac3b0 con 0x7f641015c620 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6414926700 1 --2- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 0x7f641006e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6415127700 1 --2- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f641015c620 0x7f64100ae5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6400006fd0 tx=0x7f6400009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e452af88511702 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.799+0000 7f6407fff700 1 -- 172.21.15.26:0/496051092 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400005e30 con 0x7f641015c620 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f6407fff700 1 -- 172.21.15.26:0/496051092 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400004030 con 0x7f641015c620 2023-06-09T04:39:21.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f6407fff700 1 -- 172.21.15.26:0/496051092 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000043e0 con 0x7f641015c620 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 -- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f641015c620 msgr2=0x7f64100ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 --2- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f641015c620 0x7f64100ae5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6400006fd0 tx=0x7f6400009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 -- 172.21.15.26:0/496051092 shutdown_connections 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 --2- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f641015c620 0x7f64100ae5e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 --2- 172.21.15.26:0/496051092 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64100aeb20 0x7f641006e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 -- 172.21.15.26:0/496051092 >> 172.21.15.26:0/496051092 conn(0x7f6410098b50 msgr2=0x7f64100cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 -- 172.21.15.26:0/496051092 shutdown_connections 2023-06-09T04:39:21.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.800+0000 7f641738b700 1 -- 172.21.15.26:0/496051092 wait complete. 2023-06-09T04:39:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.801+0000 7f641738b700 1 Processor -- start 2023-06-09T04:39:21.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.801+0000 7f641738b700 1 -- start start 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f641738b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f641006e8c0 0x7f64100c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f641738b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64100aeb20 0x7f641014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f641738b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 0x7f64101f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f641738b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641014da20 con 0x7f641015c620 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f641738b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64100b27c0 con 0x7f64100aeb20 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f641738b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64100c37a0 con 0x7f641006e8c0 2023-06-09T04:39:21.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f6415928700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 0x7f64101f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f6415928700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 0x7f64101f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40040/0 (socket says 172.21.15.26:40040) 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f6415928700 1 -- 172.21.15.26:0/3569603449 learned_addr learned my addr 172.21.15.26:0/3569603449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f6414926700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64100aeb20 0x7f641014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.802+0000 7f6415127700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f641006e8c0 0x7f64100c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6415928700 1 -- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f641006e8c0 msgr2=0x7f64100c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6415928700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f641006e8c0 0x7f64100c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6415928700 1 -- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64100aeb20 msgr2=0x7f641014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6415928700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64100aeb20 0x7f641014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6415928700 1 -- 172.21.15.26:0/3569603449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c0094a0 con 0x7f641015c620 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6415928700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 0x7f64101f0e30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f640800cbc0 tx=0x7f640800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800a9e0 con 0x7f641015c620 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800ab40 con 0x7f641015c620 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6400009500 con 0x7f641015c620 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408007070 con 0x7f641015c620 2023-06-09T04:39:21.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.803+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64100b2a10 con 0x7f641015c620 2023-06-09T04:39:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.804+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410067180 con 0x7f641015c620 2023-06-09T04:39:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.805+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64080071d0 con 0x7f641015c620 2023-06-09T04:39:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.805+0000 7f6405ffb700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f63f406ace0 0x7f63f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.805+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6408089150 con 0x7f641015c620 2023-06-09T04:39:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.805+0000 7f6415127700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f63f406ace0 0x7f63f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.806+0000 7f6415127700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f63f406ace0 0x7f63f406d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6400006fd0 tx=0x7f6400008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:21.810+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6408054290 con 0x7f641015c620 2023-06-09T04:39:22.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.009+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641014b070 con 0x7f641015c620 2023-06-09T04:39:22.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.010+0000 7f6405ffb700 1 -- 172.21.15.26:0/3569603449 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f6408017090 con 0x7f641015c620 2023-06-09T04:39:22.012 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:22.012 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":34,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:39:21.639242+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:39:19.329660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:39:20.618775+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f63f406ace0 msgr2=0x7f63f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f63f406ace0 0x7f63f406d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6400006fd0 tx=0x7f6400008070 comp rx=0 tx=0).stop 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 msgr2=0x7f64101f0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 0x7f64101f0e30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f640800cbc0 tx=0x7f640800ced0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 shutdown_connections 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f63f406ace0 0x7f63f406d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.012+0000 7f641738b700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f641015c620 0x7f64101f0e30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.013+0000 7f641738b700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f641006e8c0 0x7f64100c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.013+0000 7f641738b700 1 --2- 172.21.15.26:0/3569603449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64100aeb20 0x7f641014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.013+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 >> 172.21.15.26:0/3569603449 conn(0x7f6410098b50 msgr2=0x7f64100ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.013+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 shutdown_connections 2023-06-09T04:39:22.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.013+0000 7f641738b700 1 -- 172.21.15.26:0/3569603449 wait complete. 2023-06-09T04:39:22.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.151+0000 7ff6db6ea700 1 Processor -- start 2023-06-09T04:39:22.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.151+0000 7ff6db6ea700 1 -- start start 2023-06-09T04:39:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6db6ea700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6d41591d0 0x7ff6d41595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6db6ea700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6d40c9c10 0x7ff6d40ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6db6ea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d40ca790 con 0x7ff6d40cd530 2023-06-09T04:39:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6db6ea700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d4159ae0 con 0x7ff6d41591d0 2023-06-09T04:39:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6db6ea700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40ca5a0 con 0x7ff6d40c9c10 2023-06-09T04:39:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6d9486700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6d41591d0 0x7ff6d41595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6d9486700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff6d41591d0 0x7ff6d41595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40044/0 (socket says 172.21.15.26:40044) 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6d9c87700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff6d40cd530 0x7ff6d40cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48904/0 (socket says 172.21.15.26:48904) 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6d9486700 1 -- 172.21.15.26:0/3332253873 learned_addr learned my addr 172.21.15.26:0/3332253873 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.152+0000 7ff6d8c85700 1 --2- 172.21.15.26:0/3332253873 >> v2:172.21.15.104:3300/0 conn(0x7ff6d40c9c10 0x7ff6d40ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6d9486700 1 -- 172.21.15.26:0/3332253873 >> v2:172.21.15.104:3300/0 conn(0x7ff6d40c9c10 msgr2=0x7ff6d40ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6d9486700 1 --2- 172.21.15.26:0/3332253873 >> v2:172.21.15.104:3300/0 conn(0x7ff6d40c9c10 0x7ff6d40ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6d9486700 1 -- 172.21.15.26:0/3332253873 >> v1:172.21.15.26:6789/0 conn(0x7ff6d40cd530 legacy=0x7ff6d40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6d9486700 1 -- 172.21.15.26:0/3332253873 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40caa70 con 0x7ff6d41591d0 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6cbfff700 1 -- 172.21.15.26:0/3332253873 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19680440 0 0) 0x7ff6d40ca790 con 0x7ff6d40cd530 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6d8c85700 1 --2- 172.21.15.26:0/3332253873 >> v2:172.21.15.104:3300/0 conn(0x7ff6d40c9c10 0x7ff6d40ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6d9486700 1 --2- 172.21.15.26:0/3332253873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d41591d0 0x7ff6d41595a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40b1af0 tx=0x7ff6c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f40c8e72f88eb3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6cbfff700 1 -- 172.21.15.26:0/3332253873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400b860 con 0x7ff6d41591d0 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6cbfff700 1 -- 172.21.15.26:0/3332253873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400b9c0 con 0x7ff6d41591d0 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6cbfff700 1 -- 172.21.15.26:0/3332253873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400bd50 con 0x7ff6d41591d0 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6db6ea700 1 -- 172.21.15.26:0/3332253873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d41591d0 msgr2=0x7ff6d41595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.153+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/3332253873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d41591d0 0x7ff6d41595a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40b1af0 tx=0x7ff6c4009c00 comp rx=0 tx=0).stop 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.154+0000 7ff6db6ea700 1 -- 172.21.15.26:0/3332253873 shutdown_connections 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.154+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/3332253873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d41591d0 0x7ff6d41595a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.154+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/3332253873 >> v2:172.21.15.104:3300/0 conn(0x7ff6d40c9c10 0x7ff6d40ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.154+0000 7ff6db6ea700 1 -- 172.21.15.26:0/3332253873 >> 172.21.15.26:0/3332253873 conn(0x7ff6d40cb9d0 msgr2=0x7ff6d40cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.154+0000 7ff6db6ea700 1 -- 172.21.15.26:0/3332253873 shutdown_connections 2023-06-09T04:39:22.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.154+0000 7ff6db6ea700 1 -- 172.21.15.26:0/3332253873 wait complete. 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.155+0000 7ff6db6ea700 1 Processor -- start 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.155+0000 7ff6db6ea700 1 -- start start 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 0x7ff6d40c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6d40cd530 0x7ff6d40c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6d41591d0 0x7ff6d415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40c1d00 con 0x7ff6d40c9c10 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40afbf0 con 0x7ff6d40cd530 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40afe40 con 0x7ff6d41591d0 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 0x7ff6d40c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 0x7ff6d40c1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40048/0 (socket says 172.21.15.26:40048) 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 -- 172.21.15.26:0/2264682744 learned_addr learned my addr 172.21.15.26:0/2264682744 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9c87700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6d41591d0 0x7ff6d415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d8c85700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6d40cd530 0x7ff6d40c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 -- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6d41591d0 msgr2=0x7ff6d415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6d41591d0 0x7ff6d415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 -- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6d40cd530 msgr2=0x7ff6d40c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6d40cd530 0x7ff6d40c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 -- 172.21.15.26:0/2264682744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4009550 con 0x7ff6d40c9c10 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d8c85700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6d40cd530 0x7ff6d40c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:22.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9c87700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6d41591d0 0x7ff6d415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6d9486700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 0x7ff6d40c1f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4000c00 tx=0x7ff6c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40036a0 con 0x7ff6d40c9c10 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c401e070 con 0x7ff6d40c9c10 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d40b0120 con 0x7ff6d40c9c10 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.156+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4003a20 con 0x7ff6d40c9c10 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.157+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d415c900 con 0x7ff6d40c9c10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.158+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d40b4ed0 con 0x7ff6d40c9c10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.158+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6c4003b80 con 0x7ff6d40c9c10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.158+0000 7ff6c9ffb700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff6b806ace0 0x7ff6b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.159+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6c4020070 con 0x7ff6d40c9c10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.159+0000 7ff6d8c85700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff6b806ace0 0x7ff6b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.159+0000 7ff6d8c85700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff6b806ace0 0x7ff6b806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff6d409cd90 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.163+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6c4055b00 con 0x7ff6d40c9c10 2023-06-09T04:39:22.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.363+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6d406a2a0 con 0x7ff6d40c9c10 2023-06-09T04:39:22.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.364+0000 7ff6c9ffb700 1 -- 172.21.15.26:0/2264682744 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18294 (secure 0 0 0) 0x7ff6c4015020 con 0x7ff6d40c9c10 2023-06-09T04:39:22.366 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":34,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:39:21.639242+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:39:19.329660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:39:20.618775+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:22.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff6b806ace0 msgr2=0x7ff6b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff6b806ace0 0x7ff6b806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff6d409cd90 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2023-06-09T04:39:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 msgr2=0x7ff6d40c1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 0x7ff6d40c1f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4000c00 tx=0x7ff6c4004750 comp rx=0 tx=0).stop 2023-06-09T04:39:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 shutdown_connections 2023-06-09T04:39:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6d41591d0 0x7ff6d415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff6b806ace0 0x7ff6b806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6d40c9c10 0x7ff6d40c1f00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.366+0000 7ff6db6ea700 1 --2- 172.21.15.26:0/2264682744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6d40cd530 0x7ff6d40c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.367+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 >> 172.21.15.26:0/2264682744 conn(0x7ff6d40cb9d0 msgr2=0x7ff6d40add80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.367+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 shutdown_connections 2023-06-09T04:39:22.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.367+0000 7ff6db6ea700 1 -- 172.21.15.26:0/2264682744 wait complete. 2023-06-09T04:39:22.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:39:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.506+0000 7fbbbb36f700 1 Processor -- start 2023-06-09T04:39:22.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.507+0000 7fbbbb36f700 1 -- start start 2023-06-09T04:39:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.507+0000 7fbbbb36f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbb41569b0 0x7fbbb40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbbb36f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb415d950 con 0x7fbbb415d3e0 2023-06-09T04:39:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbbb36f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40cd360 con 0x7fbbb40cf370 2023-06-09T04:39:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbbb36f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb40d0970 con 0x7fbbb41569b0 2023-06-09T04:39:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb910b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbb41569b0 0x7fbbb40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb990c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbbb415d3e0 0x7fbbb40b7a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48918/0 (socket says 172.21.15.26:48918) 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb990c700 1 -- 172.21.15.26:0/591340829 learned_addr learned my addr 172.21.15.26:0/591340829 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb910b700 1 -- 172.21.15.26:0/591340829 >> v1:172.21.15.104:6789/0 conn(0x7fbbb40cf370 legacy=0x7fbbb40d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb910b700 1 -- 172.21.15.26:0/591340829 >> v1:172.21.15.26:6789/0 conn(0x7fbbb415d3e0 legacy=0x7fbbb40b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbabfff700 1 -- 172.21.15.26:0/591340829 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40072254 0 0) 0x7fbbb415d950 con 0x7fbbb415d3e0 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb910b700 1 -- 172.21.15.26:0/591340829 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40cd640 con 0x7fbbb41569b0 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbb910b700 1 --2- 172.21.15.26:0/591340829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb41569b0 0x7fbbb40cee30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009820 tx=0x7fbba4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c37c1bf106fece server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbabfff700 1 -- 172.21.15.26:0/591340829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4005e30 con 0x7fbbb41569b0 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbabfff700 1 -- 172.21.15.26:0/591340829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4004030 con 0x7fbbb41569b0 2023-06-09T04:39:22.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.508+0000 7fbbabfff700 1 -- 172.21.15.26:0/591340829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40043c0 con 0x7fbbb41569b0 2023-06-09T04:39:22.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 -- 172.21.15.26:0/591340829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb41569b0 msgr2=0x7fbbb40cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/591340829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb41569b0 0x7fbbb40cee30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009820 tx=0x7fbba4009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:22.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 -- 172.21.15.26:0/591340829 shutdown_connections 2023-06-09T04:39:22.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/591340829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb41569b0 0x7fbbb40cee30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 -- 172.21.15.26:0/591340829 >> 172.21.15.26:0/591340829 conn(0x7fbbb406b1f0 msgr2=0x7fbbb406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 -- 172.21.15.26:0/591340829 shutdown_connections 2023-06-09T04:39:22.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.509+0000 7fbbbb36f700 1 -- 172.21.15.26:0/591340829 wait complete. 2023-06-09T04:39:22.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.510+0000 7fbbbb36f700 1 Processor -- start 2023-06-09T04:39:22.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.510+0000 7fbbbb36f700 1 -- start start 2023-06-09T04:39:22.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbbb36f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 0x7fbbb40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbbb36f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbbb41569b0 0x7fbbb415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbbb36f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbb415d3e0 0x7fbbb415e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbbb36f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb41f5e10 con 0x7fbbb40cf370 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbbb36f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40b6bc0 con 0x7fbbb415d3e0 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbbb36f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c9110 con 0x7fbbb41569b0 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 0x7fbbb40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 0x7fbbb40c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40062/0 (socket says 172.21.15.26:40062) 2023-06-09T04:39:22.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 -- 172.21.15.26:0/145105106 learned_addr learned my addr 172.21.15.26:0/145105106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb890a700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbbb41569b0 0x7fbbb415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb990c700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbb415d3e0 0x7fbbb415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 -- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbbb41569b0 msgr2=0x7fbbb415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbbb41569b0 0x7fbbb415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 -- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbb415d3e0 msgr2=0x7fbbb415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbb415d3e0 0x7fbbb415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb910b700 1 -- 172.21.15.26:0/145105106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4009430 con 0x7fbbb40cf370 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.511+0000 7fbbb990c700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbb415d3e0 0x7fbbb415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.512+0000 7fbbb910b700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 0x7fbbb40c8bd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbba4000c00 tx=0x7fbba4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.512+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba401d630 con 0x7fbbb40cf370 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.512+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba401d7b0 con 0x7fbbb40cf370 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.512+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb41f5050 con 0x7fbbb40cf370 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.512+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba401db60 con 0x7fbbb40cf370 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.512+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb41f5610 con 0x7fbbb40cf370 2023-06-09T04:39:22.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.513+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb4074080 con 0x7fbbb40cf370 2023-06-09T04:39:22.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.513+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbba401dcc0 con 0x7fbbb40cf370 2023-06-09T04:39:22.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.514+0000 7fbba9ffb700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb9806ace0 0x7fbb9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.514+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbba408aba0 con 0x7fbbb40cf370 2023-06-09T04:39:22.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.514+0000 7fbbb890a700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb9806ace0 0x7fbb9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.514+0000 7fbbb890a700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb9806ace0 0x7fbb9806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbbb415ee90 tx=0x7fbbb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.518+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbba4055ce0 con 0x7fbbb40cf370 2023-06-09T04:39:22.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:22.768+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbbb40b4660 con 0x7fbbb40cf370 2023-06-09T04:39:23.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.655+0000 7fbba9ffb700 1 -- 172.21.15.26:0/145105106 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbba4059300 con 0x7fbbb40cf370 2023-06-09T04:39:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb9806ace0 msgr2=0x7fbb9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb9806ace0 0x7fbb9806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbbb415ee90 tx=0x7fbbb0008040 comp rx=0 tx=0).stop 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 msgr2=0x7fbbb40c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 0x7fbbb40c8bd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbba4000c00 tx=0x7fbba4004750 comp rx=0 tx=0).stop 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 shutdown_connections 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbb415d3e0 0x7fbbb415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fbb9806ace0 0x7fbb9806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbb40cf370 0x7fbbb40c8bd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 --2- 172.21.15.26:0/145105106 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbbb41569b0 0x7fbbb415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 >> 172.21.15.26:0/145105106 conn(0x7fbbb406b1f0 msgr2=0x7fbbb40d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 shutdown_connections 2023-06-09T04:39:23.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.658+0000 7fbbbb36f700 1 -- 172.21.15.26:0/145105106 wait complete. 2023-06-09T04:39:23.675 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:39:23.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:39:23.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.811+0000 7f89982d0700 1 Processor -- start 2023-06-09T04:39:23.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.811+0000 7f89982d0700 1 -- start start 2023-06-09T04:39:23.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f89982d0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f899015c6e0 0x7f89900ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f89982d0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f899006e990 0x7f89900aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f89982d0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899006f190 con 0x7f8990098e30 2023-06-09T04:39:23.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f89982d0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899006e440 con 0x7f899006e990 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f89982d0700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899006e690 con 0x7f899015c6e0 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f899586b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f899006e990 0x7f89900aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f899586b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f899006e990 0x7f89900aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40074/0 (socket says 172.21.15.26:40074) 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f899686d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8990098e30 0x7f89900cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48930/0 (socket says 172.21.15.26:48930) 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f899586b700 1 -- 172.21.15.26:0/3221865677 learned_addr learned my addr 172.21.15.26:0/3221865677 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.812+0000 7f899606c700 1 --2- 172.21.15.26:0/3221865677 >> v2:172.21.15.104:3300/0 conn(0x7f899015c6e0 0x7f89900ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899586b700 1 -- 172.21.15.26:0/3221865677 >> v2:172.21.15.104:3300/0 conn(0x7f899015c6e0 msgr2=0x7f89900ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899586b700 1 --2- 172.21.15.26:0/3221865677 >> v2:172.21.15.104:3300/0 conn(0x7f899015c6e0 0x7f89900ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899586b700 1 -- 172.21.15.26:0/3221865677 >> v1:172.21.15.26:6789/0 conn(0x7f8990098e30 legacy=0x7f89900cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899506a700 1 -- 172.21.15.26:0/3221865677 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059461975 0 0) 0x7f899006f190 con 0x7f8990098e30 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899586b700 1 -- 172.21.15.26:0/3221865677 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8990160300 con 0x7f899006e990 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899586b700 1 --2- 172.21.15.26:0/3221865677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900aeb80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f89900b23a0 tx=0x7f898c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba55885ea184d4c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899506a700 1 -- 172.21.15.26:0/3221865677 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00b870 con 0x7f899006e990 2023-06-09T04:39:23.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899506a700 1 -- 172.21.15.26:0/3221865677 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00b9d0 con 0x7f899006e990 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f899506a700 1 -- 172.21.15.26:0/3221865677 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00bd60 con 0x7f899006e990 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.813+0000 7f89982d0700 1 -- 172.21.15.26:0/3221865677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 msgr2=0x7f89900aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 --2- 172.21.15.26:0/3221865677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900aeb80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f89900b23a0 tx=0x7f898c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 -- 172.21.15.26:0/3221865677 shutdown_connections 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 --2- 172.21.15.26:0/3221865677 >> v2:172.21.15.104:3300/0 conn(0x7f899015c6e0 0x7f89900ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 --2- 172.21.15.26:0/3221865677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900aeb80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 -- 172.21.15.26:0/3221865677 >> 172.21.15.26:0/3221865677 conn(0x7f8990098a30 msgr2=0x7f89900cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 -- 172.21.15.26:0/3221865677 shutdown_connections 2023-06-09T04:39:23.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.814+0000 7f89982d0700 1 -- 172.21.15.26:0/3221865677 wait complete. 2023-06-09T04:39:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.815+0000 7f89982d0700 1 Processor -- start 2023-06-09T04:39:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.815+0000 7f89982d0700 1 -- start start 2023-06-09T04:39:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f89982d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f89982d0700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8990098e30 0x7f89900c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f89982d0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f899015c6e0 0x7f89900c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f89982d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900b1b10 con 0x7f899006e990 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f89982d0700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900afdf0 con 0x7f899015c6e0 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f89982d0700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900b1220 con 0x7f8990098e30 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40076/0 (socket says 172.21.15.26:40076) 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 -- 172.21.15.26:0/821735981 learned_addr learned my addr 172.21.15.26:0/821735981 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:23.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899686d700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f899015c6e0 0x7f89900c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899586b700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8990098e30 0x7f89900c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 -- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8990098e30 msgr2=0x7f89900c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8990098e30 0x7f89900c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 -- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f899015c6e0 msgr2=0x7f89900c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f899015c6e0 0x7f89900c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 -- 172.21.15.26:0/821735981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009550 con 0x7f899006e990 2023-06-09T04:39:23.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899586b700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8990098e30 0x7f89900c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f899606c700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900af8b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f898000d7d0 tx=0x7f898000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.816+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800125f0 con 0x7f899006e990 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.817+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980012750 con 0x7f899006e990 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.817+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980012b00 con 0x7f899006e990 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.817+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89900c8590 con 0x7f899006e990 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.817+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89900b17a0 con 0x7f899006e990 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.817+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990067180 con 0x7f899006e990 2023-06-09T04:39:23.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.818+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8980012c60 con 0x7f899006e990 2023-06-09T04:39:23.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.818+0000 7f8986ffd700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f897406ace0 0x7f897406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.818+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89800895f0 con 0x7f899006e990 2023-06-09T04:39:23.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.819+0000 7f899586b700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f897406ace0 0x7f897406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.819+0000 7f899586b700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f897406ace0 0x7f897406d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89900b52a0 tx=0x7f898c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:23.823+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89800546a0 con 0x7f899006e990 2023-06-09T04:39:24.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.065+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f89901608c0 con 0x7f899006e990 2023-06-09T04:39:24.209 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-06-09T04:39:24.209+0000 7f6396a6b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:39:24.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.660+0000 7f8986ffd700 1 -- 172.21.15.26:0/821735981 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8980057cc0 con 0x7f899006e990 2023-06-09T04:39:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.662+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f897406ace0 msgr2=0x7f897406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.662+0000 7f89982d0700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f897406ace0 0x7f897406d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89900b52a0 tx=0x7f898c008030 comp rx=0 tx=0).stop 2023-06-09T04:39:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.662+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 msgr2=0x7f89900af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.662+0000 7f89982d0700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900af8b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f898000d7d0 tx=0x7f898000db90 comp rx=0 tx=0).stop 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 shutdown_connections 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f899015c6e0 0x7f89900c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f897406ace0 0x7f897406d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f899006e990 0x7f89900af8b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 --2- 172.21.15.26:0/821735981 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8990098e30 0x7f89900c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 >> 172.21.15.26:0/821735981 conn(0x7f8990098a30 msgr2=0x7f89900cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 shutdown_connections 2023-06-09T04:39:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.663+0000 7f89982d0700 1 -- 172.21.15.26:0/821735981 wait complete. 2023-06-09T04:39:24.679 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:39:24.679 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:24.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 Processor -- start 2023-06-09T04:39:24.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 -- start start 2023-06-09T04:39:24.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd680ccb60 0x7fcd680ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd6806c860 0x7fcd6806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd680cd4f0 con 0x7fcd68158a90 2023-06-09T04:39:24.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6815d4d0 con 0x7fcd680ccb60 2023-06-09T04:39:24.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.809+0000 7fcd6da41700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68158e60 con 0x7fcd6806c860 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd667fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd680ccb60 0x7fcd680ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd66ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcd68158a90 0x7fcd68069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48942/0 (socket says 172.21.15.26:48942) 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd66ffd700 1 -- 172.21.15.26:0/3663165009 learned_addr learned my addr 172.21.15.26:0/3663165009 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd677fe700 1 --2- 172.21.15.26:0/3663165009 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd6806c860 0x7fcd6806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd667fc700 1 -- 172.21.15.26:0/3663165009 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd6806c860 msgr2=0x7fcd6806cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd667fc700 1 --2- 172.21.15.26:0/3663165009 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd6806c860 0x7fcd6806cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd667fc700 1 -- 172.21.15.26:0/3663165009 >> v1:172.21.15.26:6789/0 conn(0x7fcd68158a90 legacy=0x7fcd68069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd65ffb700 1 -- 172.21.15.26:0/3663165009 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142591978 0 0) 0x7fcd58001110 con 0x7fcd68158a90 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd667fc700 1 -- 172.21.15.26:0/3663165009 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6815c5e0 con 0x7fcd680ccb60 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd667fc700 1 --2- 172.21.15.26:0/3663165009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd680ccb60 0x7fcd680ccfb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009870 tx=0x7fcd5c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672b6f9d0cad4c74 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd65ffb700 1 -- 172.21.15.26:0/3663165009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c011830 con 0x7fcd680ccb60 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd65ffb700 1 -- 172.21.15.26:0/3663165009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c011990 con 0x7fcd680ccb60 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.810+0000 7fcd65ffb700 1 -- 172.21.15.26:0/3663165009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c011d20 con 0x7fcd680ccb60 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 -- 172.21.15.26:0/3663165009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd680ccb60 msgr2=0x7fcd680ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3663165009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd680ccb60 0x7fcd680ccfb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009870 tx=0x7fcd5c009b80 comp rx=0 tx=0).stop 2023-06-09T04:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 -- 172.21.15.26:0/3663165009 shutdown_connections 2023-06-09T04:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3663165009 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd6806c860 0x7fcd6806cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3663165009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd680ccb60 0x7fcd680ccfb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 -- 172.21.15.26:0/3663165009 >> 172.21.15.26:0/3663165009 conn(0x7fcd680cbe20 msgr2=0x7fcd680ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 -- 172.21.15.26:0/3663165009 shutdown_connections 2023-06-09T04:39:24.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.811+0000 7fcd6da41700 1 -- 172.21.15.26:0/3663165009 wait complete. 2023-06-09T04:39:24.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.812+0000 7fcd6da41700 1 Processor -- start 2023-06-09T04:39:24.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.812+0000 7fcd6da41700 1 -- start start 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd6da41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 0x7fcd68159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd6da41700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd680ccb60 0x7fcd68143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd6da41700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd68158a90 0x7fcd68151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd6da41700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd681512c0 con 0x7fcd6806c860 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd6da41700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd681506b0 con 0x7fcd68158a90 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd6da41700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68150990 con 0x7fcd680ccb60 2023-06-09T04:39:24.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 0x7fcd68159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 0x7fcd68159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40090/0 (socket says 172.21.15.26:40090) 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 -- 172.21.15.26:0/3842560443 learned_addr learned my addr 172.21.15.26:0/3842560443 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd677fe700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd68158a90 0x7fcd68151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd667fc700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd680ccb60 0x7fcd68143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 -- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd680ccb60 msgr2=0x7fcd68143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd680ccb60 0x7fcd68143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 -- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd68158a90 msgr2=0x7fcd68151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd68158a90 0x7fcd68151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.813+0000 7fcd66ffd700 1 -- 172.21.15.26:0/3842560443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c0094a0 con 0x7fcd6806c860 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.814+0000 7fcd66ffd700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 0x7fcd68159210 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c550 tx=0x7fcd5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.814+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58004c80 con 0x7fcd6806c860 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.814+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58004e00 con 0x7fcd6806c860 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.814+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68150c70 con 0x7fcd6806c860 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.814+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58007310 con 0x7fcd6806c860 2023-06-09T04:39:24.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.814+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68159750 con 0x7fcd6806c860 2023-06-09T04:39:24.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.815+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd681515a0 con 0x7fcd6806c860 2023-06-09T04:39:24.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.815+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd58007470 con 0x7fcd6806c860 2023-06-09T04:39:24.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.816+0000 7fcd4ffff700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcd5406ace0 0x7fcd5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.816+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd58089100 con 0x7fcd6806c860 2023-06-09T04:39:24.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.816+0000 7fcd667fc700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcd5406ace0 0x7fcd5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.816+0000 7fcd667fc700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcd5406ace0 0x7fcd5406d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009870 tx=0x7fcd5c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:24.820+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd58054110 con 0x7fcd6806c860 2023-06-09T04:39:25.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.062+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd68074080 con 0x7fcd6806c860 2023-06-09T04:39:25.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.062+0000 7fcd4ffff700 1 -- 172.21.15.26:0/3842560443 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fcd58057730 con 0x7fcd6806c860 2023-06-09T04:39:25.063 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:25.064 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4847,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/1092023330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":1092023330},{"type":"v1","addr":"172.21.15.104:6837","nonce":1092023330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/795405211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":795405211},{"type":"v1","addr":"172.21.15.104:6836","nonce":795405211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1173816148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1173816148},{"type":"v1","addr":"172.21.15.26:6834","nonce":1173816148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:39:21.639561+0000","modified":"2023-06-09T04:39:24.654718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.26:6835/3278830041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3278830041},{"type":"v1","addr":"172.21.15.26:6835","nonce":3278830041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:39:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcd5406ace0 msgr2=0x7fcd5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcd5406ace0 0x7fcd5406d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009870 tx=0x7fcd5c008030 comp rx=0 tx=0).stop 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 msgr2=0x7fcd68159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 0x7fcd68159210 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c550 tx=0x7fcd5800c910 comp rx=0 tx=0).stop 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 shutdown_connections 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd68158a90 0x7fcd68151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fcd5406ace0 0x7fcd5406d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd6806c860 0x7fcd68159210 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 --2- 172.21.15.26:0/3842560443 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd680ccb60 0x7fcd68143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 >> 172.21.15.26:0/3842560443 conn(0x7fcd680cbe20 msgr2=0x7fcd68069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 shutdown_connections 2023-06-09T04:39:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.064+0000 7fcd6da41700 1 -- 172.21.15.26:0/3842560443 wait complete. 2023-06-09T04:39:25.067 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 15 2023-06-09T04:39:25.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:25.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.201+0000 7fc269973700 1 Processor -- start 2023-06-09T04:39:25.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.202+0000 7fc269973700 1 -- start start 2023-06-09T04:39:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc269973700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc264159d00 0x7fc26415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc269973700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640cf400 con 0x7fc2640d1840 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc269973700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26415d830 con 0x7fc2640d0c50 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc269973700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640ceec0 con 0x7fc264159d00 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc2627fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc2640d1840 0x7fc2640cf890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48956/0 (socket says 172.21.15.26:48956) 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc2627fc700 1 -- 172.21.15.26:0/23175826 learned_addr learned my addr 172.21.15.26:0/23175826 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc262ffd700 1 --2- 172.21.15.26:0/23175826 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc264159d00 0x7fc26415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677834173 0 0) 0x7fc2640cf400 con 0x7fc2640d1840 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2500035b0 con 0x7fc2640d1840 2023-06-09T04:39:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247844380 0 0) 0x7fc26415d830 con 0x7fc2640d0c50 2023-06-09T04:39:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2640cf400 con 0x7fc2640d0c50 2023-06-09T04:39:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4199473678 0 0) 0x7fc2500035b0 con 0x7fc2640d1840 2023-06-09T04:39:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc262ffd700 1 -- 172.21.15.26:0/23175826 >> v1:172.21.15.104:6789/0 conn(0x7fc2640d0c50 legacy=0x7fc2640d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc262ffd700 1 -- 172.21.15.26:0/23175826 >> v1:172.21.15.26:6789/0 conn(0x7fc2640d1840 legacy=0x7fc2640cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.203+0000 7fc262ffd700 1 -- 172.21.15.26:0/23175826 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640cf0d0 con 0x7fc264159d00 2023-06-09T04:39:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc262ffd700 1 --2- 172.21.15.26:0/23175826 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc264159d00 0x7fc26415d2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc254009850 tx=0x7fc254009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fee8cd31d04fbe10 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c001670 con 0x7fc264159d00 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254005c30 con 0x7fc264159d00 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc261ffb700 1 -- 172.21.15.26:0/23175826 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254004030 con 0x7fc264159d00 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc269973700 1 -- 172.21.15.26:0/23175826 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc264159d00 msgr2=0x7fc26415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc269973700 1 --2- 172.21.15.26:0/23175826 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc264159d00 0x7fc26415d2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc254009850 tx=0x7fc254009b60 comp rx=0 tx=0).stop 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc269973700 1 -- 172.21.15.26:0/23175826 shutdown_connections 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc269973700 1 --2- 172.21.15.26:0/23175826 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc264159d00 0x7fc26415d2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.204+0000 7fc269973700 1 -- 172.21.15.26:0/23175826 >> 172.21.15.26:0/23175826 conn(0x7fc2640714e0 msgr2=0x7fc2640718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.205+0000 7fc269973700 1 -- 172.21.15.26:0/23175826 shutdown_connections 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.205+0000 7fc269973700 1 -- 172.21.15.26:0/23175826 wait complete. 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.206+0000 7fc269973700 1 Processor -- start 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.206+0000 7fc269973700 1 -- start start 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 0x7fc26414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2640d1840 0x7fc2641f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc264159d00 0x7fc2640c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26414ea50 con 0x7fc2640d0c50 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2641f2ee0 con 0x7fc264159d00 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640c99d0 con 0x7fc2640d1840 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 0x7fc26414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 0x7fc26414d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40104/0 (socket says 172.21.15.26:40104) 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 -- 172.21.15.26:0/2014842378 learned_addr learned my addr 172.21.15.26:0/2014842378 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc2627fc700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2640d1840 0x7fc2641f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc2637fe700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc264159d00 0x7fc2640c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 -- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2640d1840 msgr2=0x7fc2641f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2640d1840 0x7fc2641f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 -- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc264159d00 msgr2=0x7fc2640c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc264159d00 0x7fc2640c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 -- 172.21.15.26:0/2014842378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009430 con 0x7fc2640d0c50 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc2637fe700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc264159d00 0x7fc2640c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc262ffd700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 0x7fc26414d410 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc2640d3d40 tx=0x7fc254004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254003b30 con 0x7fc2640d0c50 2023-06-09T04:39:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2641f2010 con 0x7fc2640d0c50 2023-06-09T04:39:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254003c90 con 0x7fc2640d0c50 2023-06-09T04:39:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25401d430 con 0x7fc2640d0c50 2023-06-09T04:39:25.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.207+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2641f25b0 con 0x7fc2640d0c50 2023-06-09T04:39:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.208+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc264073be0 con 0x7fc2640d0c50 2023-06-09T04:39:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.209+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc25401d590 con 0x7fc2640d0c50 2023-06-09T04:39:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.209+0000 7fc25bfff700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc24406ace0 0x7fc24406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.209+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc25408a770 con 0x7fc2640d0c50 2023-06-09T04:39:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.209+0000 7fc2627fc700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc24406ace0 0x7fc24406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.210+0000 7fc2627fc700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc24406ace0 0x7fc24406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc26415c2d0 tx=0x7fc24c0014b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.213+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc254055830 con 0x7fc2640d0c50 2023-06-09T04:39:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.412+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc264074080 con 0x7fc2640d0c50 2023-06-09T04:39:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.413+0000 7fc25bfff700 1 -- 172.21.15.26:0/2014842378 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fc254058e50 con 0x7fc2640d0c50 2023-06-09T04:39:25.415 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:25.415 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":35,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","created":"2023-06-09T04:37:52.278937+0000","modified":"2023-06-09T04:39:22.641379+0000","last_up_change":"2023-06-09T04:38:03.129172+0000","last_in_change":"2023-06-09T04:37:54.693799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:38:03.559240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:38:03.929804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:39:19.329660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:39:20.618775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d5fe96e-ac4c-4263-8ed2-7db23de9c606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6809","nonce":2356311551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6811","nonce":2356311551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6815","nonce":2356311551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":2356311551},{"type":"v1","addr":"172.21.15.26:6813","nonce":2356311551}]},"public_addr":"172.21.15.26:6809/2356311551","cluster_addr":"172.21.15.26:6811/2356311551","heartbeat_back_addr":"172.21.15.26:6815/2356311551","heartbeat_front_addr":"172.21.15.26:6813/2356311551","state":["exists","up"]},{"osd":1,"uuid":"a49b871f-09ea-470c-a93b-b58e6a0a9c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6801","nonce":2969833146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6803","nonce":2969833146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6807","nonce":2969833146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2969833146},{"type":"v1","addr":"172.21.15.26:6805","nonce":2969833146}]},"public_addr":"172.21.15.26:6801/2969833146","cluster_addr":"172.21.15.26:6803/2969833146","heartbeat_back_addr":"172.21.15.26:6807/2969833146","heartbeat_front_addr":"172.21.15.26:6805/2969833146","state":["exists","up"]},{"osd":2,"uuid":"f27e1ade-4207-470b-a232-ded8a7c9b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6817","nonce":2836286982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6819","nonce":2836286982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6823","nonce":2836286982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2836286982},{"type":"v1","addr":"172.21.15.26:6821","nonce":2836286982}]},"public_addr":"172.21.15.26:6817/2836286982","cluster_addr":"172.21.15.26:6819/2836286982","heartbeat_back_addr":"172.21.15.26:6823/2836286982","heartbeat_front_addr":"172.21.15.26:6821/2836286982","state":["exists","up"]},{"osd":3,"uuid":"358b6990-e0b7-4a6e-8bf0-ec1f0a69fbc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6825","nonce":2290214503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6827","nonce":2290214503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6831","nonce":2290214503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":2290214503},{"type":"v1","addr":"172.21.15.26:6829","nonce":2290214503}]},"public_addr":"172.21.15.26:6825/2290214503","cluster_addr":"172.21.15.26:6827/2290214503","heartbeat_back_addr":"172.21.15.26:6831/2290214503","heartbeat_front_addr":"172.21.15.26:6829/2290214503","state":["exists","up"]},{"osd":4,"uuid":"2bba81e1-6c3b-475a-8bc2-a9b2a2e8d6e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6810","nonce":424802580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6814","nonce":424802580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6822","nonce":424802580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":424802580},{"type":"v1","addr":"172.21.15.104:6818","nonce":424802580}]},"public_addr":"172.21.15.104:6810/424802580","cluster_addr":"172.21.15.104:6814/424802580","heartbeat_back_addr":"172.21.15.104:6822/424802580","heartbeat_front_addr":"172.21.15.104:6818/424802580","state":["exists","up"]},{"osd":5,"uuid":"6269c0a7-b639-4d47-b782-365766e42068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6825","nonce":397687055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6827","nonce":397687055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6831","nonce":397687055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":397687055},{"type":"v1","addr":"172.21.15.104:6829","nonce":397687055}]},"public_addr":"172.21.15.104:6825/397687055","cluster_addr":"172.21.15.104:6827/397687055","heartbeat_back_addr":"172.21.15.104:6831/397687055","heartbeat_front_addr":"172.21.15.104:6829/397687055","state":["exists","up"]},{"osd":6,"uuid":"29628cc4-8756-4c1f-8af8-108fcd116943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6811","nonce":1716080601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6815","nonce":1716080601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6823","nonce":1716080601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":1716080601},{"type":"v1","addr":"172.21.15.104:6819","nonce":1716080601}]},"public_addr":"172.21.15.104:6811/1716080601","cluster_addr":"172.21.15.104:6815/1716080601","heartbeat_back_addr":"172.21.15.104:6823/1716080601","heartbeat_front_addr":"172.21.15.104:6819/1716080601","state":["exists","up"]},{"osd":7,"uuid":"6f416d08-ee4f-475f-8d3a-1d26b0efac99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6801","nonce":1608970097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6803","nonce":1608970097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6807","nonce":1608970097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1608970097},{"type":"v1","addr":"172.21.15.104:6805","nonce":1608970097}]},"public_addr":"172.21.15.104:6801/1608970097","cluster_addr":"172.21.15.104:6803/1608970097","heartbeat_back_addr":"172.21.15.104:6807/1608970097","heartbeat_front_addr":"172.21.15.104:6805/1608970097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.931718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.647436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.938018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.846848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.936175+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.952975+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.926755+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:59.930780+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc24406ace0 msgr2=0x7fc24406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc24406ace0 0x7fc24406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc26415c2d0 tx=0x7fc24c0014b0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 msgr2=0x7fc26414d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 0x7fc26414d410 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc2640d3d40 tx=0x7fc254004750 comp rx=0 tx=0).stop 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 shutdown_connections 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc264159d00 0x7fc2640c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fc24406ace0 0x7fc24406d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2640d0c50 0x7fc26414d410 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 --2- 172.21.15.26:0/2014842378 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc2640d1840 0x7fc2641f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 >> 172.21.15.26:0/2014842378 conn(0x7fc2640714e0 msgr2=0x7fc2640cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 shutdown_connections 2023-06-09T04:39:25.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.415+0000 7fc269973700 1 -- 172.21.15.26:0/2014842378 wait complete. 2023-06-09T04:39:25.429 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:39:25.429 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:25.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.552+0000 7f3b1248f700 1 Processor -- start 2023-06-09T04:39:25.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.552+0000 7f3b1248f700 1 -- start start 2023-06-09T04:39:25.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b1248f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b0c0aed90 0x7f3b0c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b1248f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3b0c0ca370 0x7f3b0c0ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b1248f700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c159880 con 0x7f3b0c0ceae0 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b1248f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0ca810 con 0x7f3b0c0aed90 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b1248f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0cda30 con 0x7f3b0c0ca370 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b0c0aed90 0x7f3b0c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b10a2c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3b0c0ceae0 0x7f3b0c0cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48974/0 (socket says 172.21.15.26:48974) 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b0c0aed90 0x7f3b0c0c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40112/0 (socket says 172.21.15.26:40112) 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b10a2c700 1 -- 172.21.15.26:0/172424303 learned_addr learned my addr 172.21.15.26:0/172424303 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0b7fe700 1 --2- 172.21.15.26:0/172424303 >> v2:172.21.15.104:3300/0 conn(0x7f3b0c0ca370 0x7f3b0c0ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 -- 172.21.15.26:0/172424303 >> v2:172.21.15.104:3300/0 conn(0x7f3b0c0ca370 msgr2=0x7f3b0c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 --2- 172.21.15.26:0/172424303 >> v2:172.21.15.104:3300/0 conn(0x7f3b0c0ca370 0x7f3b0c0ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 -- 172.21.15.26:0/172424303 >> v1:172.21.15.26:6789/0 conn(0x7f3b0c0ceae0 legacy=0x7f3b0c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 -- 172.21.15.26:0/172424303 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c06cff0 con 0x7f3b0c0aed90 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.553+0000 7f3b0bfff700 1 --2- 172.21.15.26:0/172424303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0aed90 0x7f3b0c0c9e30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0724d0 tx=0x7f3b00009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2801910fddaf8950 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b0affd700 1 -- 172.21.15.26:0/172424303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00005e30 con 0x7f3b0c0aed90 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b0affd700 1 -- 172.21.15.26:0/172424303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00006030 con 0x7f3b0c0aed90 2023-06-09T04:39:25.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b0affd700 1 -- 172.21.15.26:0/172424303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000063c0 con 0x7f3b0c0aed90 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 -- 172.21.15.26:0/172424303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0aed90 msgr2=0x7f3b0c0c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 --2- 172.21.15.26:0/172424303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0aed90 0x7f3b0c0c9e30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0724d0 tx=0x7f3b00009b30 comp rx=0 tx=0).stop 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 -- 172.21.15.26:0/172424303 shutdown_connections 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 --2- 172.21.15.26:0/172424303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0aed90 0x7f3b0c0c9e30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 --2- 172.21.15.26:0/172424303 >> v2:172.21.15.104:3300/0 conn(0x7f3b0c0ca370 0x7f3b0c0ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 -- 172.21.15.26:0/172424303 >> 172.21.15.26:0/172424303 conn(0x7f3b0c098a30 msgr2=0x7f3b0c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 -- 172.21.15.26:0/172424303 shutdown_connections 2023-06-09T04:39:25.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.554+0000 7f3b1248f700 1 -- 172.21.15.26:0/172424303 wait complete. 2023-06-09T04:39:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.555+0000 7f3b1248f700 1 Processor -- start 2023-06-09T04:39:25.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 -- start start 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b0c0aed90 0x7f3b0c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 0x7f3b0c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b0c0ceae0 0x7f3b0c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1f1fa0 con 0x7f3b0c0ca370 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c151170 con 0x7f3b0c0ceae0 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b1248f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0b4ab0 con 0x7f3b0c0aed90 2023-06-09T04:39:25.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.556+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 0x7f3b0c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 0x7f3b0c0b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40122/0 (socket says 172.21.15.26:40122) 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 -- 172.21.15.26:0/953685732 learned_addr learned my addr 172.21.15.26:0/953685732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0bfff700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b0c0aed90 0x7f3b0c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b10a2c700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b0c0ceae0 0x7f3b0c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 -- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b0c0aed90 msgr2=0x7f3b0c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b0c0aed90 0x7f3b0c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 -- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b0c0ceae0 msgr2=0x7f3b0c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b0c0ceae0 0x7f3b0c0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 -- 172.21.15.26:0/953685732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00009430 con 0x7f3b0c0ca370 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b0b7fe700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 0x7f3b0c0b39c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00e870 tx=0x7f3afc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc009590 con 0x7f3b0c0ca370 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc00ee70 con 0x7f3b0c0ca370 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00ca50 con 0x7f3b0c0ca370 2023-06-09T04:39:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c150d80 con 0x7f3b0c0ca370 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.557+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c0b44f0 con 0x7f3b0c0ca370 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.558+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c067180 con 0x7f3b0c0ca370 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.559+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3afc00cbb0 con 0x7f3b0c0ca370 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.559+0000 7f3b08ff9700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3af806ace0 0x7f3af806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.559+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3afc0893e0 con 0x7f3b0c0ca370 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.559+0000 7f3b0bfff700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3af806ace0 0x7f3af806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.560+0000 7f3b0bfff700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3af806ace0 0x7f3af806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009b70 tx=0x7f3b00008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.564+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3afc057f20 con 0x7f3b0c0ca370 2023-06-09T04:39:25.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.759+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b0c06d260 con 0x7f3af806ace0 2023-06-09T04:39:25.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.768+0000 7f3b08ff9700 1 -- 172.21.15.26:0/953685732 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304610 (secure 0 0 0) 0x7f3b00005db0 con 0x7f3af806ace0 2023-06-09T04:39:25.772 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.771+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3af806ace0 msgr2=0x7f3af806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.771+0000 7f3b1248f700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3af806ace0 0x7f3af806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009b70 tx=0x7f3b00008070 comp rx=0 tx=0).stop 2023-06-09T04:39:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.771+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 msgr2=0x7f3b0c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.771+0000 7f3b1248f700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 0x7f3b0c0b39c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00e870 tx=0x7f3afc00ec30 comp rx=0 tx=0).stop 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 shutdown_connections 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3b0c0ceae0 0x7f3b0c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3b0c0aed90 0x7f3b0c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f3af806ace0 0x7f3af806d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 --2- 172.21.15.26:0/953685732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b0c0ca370 0x7f3b0c0b39c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 >> 172.21.15.26:0/953685732 conn(0x7f3b0c098a30 msgr2=0x7f3b0c0ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 shutdown_connections 2023-06-09T04:39:25.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.772+0000 7f3b1248f700 1 -- 172.21.15.26:0/953685732 wait complete. 2023-06-09T04:39:25.776 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:39:25.785 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-06-09T04:39:23.891598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":4024,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":4120576,"data_stored":2364075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001045"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663565+0000","last_change":"2023-06-09T04:39:21.656640+0000","last_active":"2023-06-09T04:39:21.663565+0000","last_peered":"2023-06-09T04:39:21.663565+0000","last_clean":"2023-06-09T04:39:21.663565+0000","last_became_active":"2023-06-09T04:39:21.656327+0000","last_became_peered":"2023-06-09T04:39:21.656327+0000","last_unstale":"2023-06-09T04:39:21.663565+0000","last_undegraded":"2023-06-09T04:39:21.663565+0000","last_fullsized":"2023-06-09T04:39:21.663565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:15:42.641330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673621+0000","last_change":"2023-06-09T04:39:21.667684+0000","last_active":"2023-06-09T04:39:21.673621+0000","last_peered":"2023-06-09T04:39:21.673621+0000","last_clean":"2023-06-09T04:39:21.673621+0000","last_became_active":"2023-06-09T04:39:21.667405+0000","last_became_peered":"2023-06-09T04:39:21.667405+0000","last_unstale":"2023-06-09T04:39:21.673621+0000","last_undegraded":"2023-06-09T04:39:21.673621+0000","last_fullsized":"2023-06-09T04:39:21.673621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:26:28.646322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.665154+0000","last_change":"2023-06-09T04:39:21.664282+0000","last_active":"2023-06-09T04:39:21.665154+0000","last_peered":"2023-06-09T04:39:21.665154+0000","last_clean":"2023-06-09T04:39:21.665154+0000","last_became_active":"2023-06-09T04:39:21.663967+0000","last_became_peered":"2023-06-09T04:39:21.663967+0000","last_unstale":"2023-06-09T04:39:21.665154+0000","last_undegraded":"2023-06-09T04:39:21.665154+0000","last_fullsized":"2023-06-09T04:39:21.665154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:49:11.644325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673470+0000","last_change":"2023-06-09T04:39:21.671769+0000","last_active":"2023-06-09T04:39:21.673470+0000","last_peered":"2023-06-09T04:39:21.673470+0000","last_clean":"2023-06-09T04:39:21.673470+0000","last_became_active":"2023-06-09T04:39:21.671502+0000","last_became_peered":"2023-06-09T04:39:21.671502+0000","last_unstale":"2023-06-09T04:39:21.673470+0000","last_undegraded":"2023-06-09T04:39:21.673470+0000","last_fullsized":"2023-06-09T04:39:21.673470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:48.864987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673495+0000","last_change":"2023-06-09T04:39:21.671424+0000","last_active":"2023-06-09T04:39:21.673495+0000","last_peered":"2023-06-09T04:39:21.673495+0000","last_clean":"2023-06-09T04:39:21.673495+0000","last_became_active":"2023-06-09T04:39:21.671159+0000","last_became_peered":"2023-06-09T04:39:21.671159+0000","last_unstale":"2023-06-09T04:39:21.673495+0000","last_undegraded":"2023-06-09T04:39:21.673495+0000","last_fullsized":"2023-06-09T04:39:21.673495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:42:11.603090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651753+0000","last_change":"2023-06-09T04:39:21.662768+0000","last_active":"2023-06-09T04:39:22.651753+0000","last_peered":"2023-06-09T04:39:22.651753+0000","last_clean":"2023-06-09T04:39:22.651753+0000","last_became_active":"2023-06-09T04:39:21.662556+0000","last_became_peered":"2023-06-09T04:39:21.662556+0000","last_unstale":"2023-06-09T04:39:22.651753+0000","last_undegraded":"2023-06-09T04:39:22.651753+0000","last_fullsized":"2023-06-09T04:39:22.651753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:09:18.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673683+0000","last_change":"2023-06-09T04:39:21.668565+0000","last_active":"2023-06-09T04:39:21.673683+0000","last_peered":"2023-06-09T04:39:21.673683+0000","last_clean":"2023-06-09T04:39:21.673683+0000","last_became_active":"2023-06-09T04:39:21.668307+0000","last_became_peered":"2023-06-09T04:39:21.668307+0000","last_unstale":"2023-06-09T04:39:21.673683+0000","last_undegraded":"2023-06-09T04:39:21.673683+0000","last_fullsized":"2023-06-09T04:39:21.673683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:51:00.140813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672320+0000","last_change":"2023-06-09T04:39:21.668549+0000","last_active":"2023-06-09T04:39:21.672320+0000","last_peered":"2023-06-09T04:39:21.672320+0000","last_clean":"2023-06-09T04:39:21.672320+0000","last_became_active":"2023-06-09T04:39:21.668311+0000","last_became_peered":"2023-06-09T04:39:21.668311+0000","last_unstale":"2023-06-09T04:39:21.672320+0000","last_undegraded":"2023-06-09T04:39:21.672320+0000","last_fullsized":"2023-06-09T04:39:21.672320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:23.601535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672344+0000","last_change":"2023-06-09T04:39:21.669449+0000","last_active":"2023-06-09T04:39:21.672344+0000","last_peered":"2023-06-09T04:39:21.672344+0000","last_clean":"2023-06-09T04:39:21.672344+0000","last_became_active":"2023-06-09T04:39:21.669107+0000","last_became_peered":"2023-06-09T04:39:21.669107+0000","last_unstale":"2023-06-09T04:39:21.672344+0000","last_undegraded":"2023-06-09T04:39:21.672344+0000","last_fullsized":"2023-06-09T04:39:21.672344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:09:18.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672884+0000","last_change":"2023-06-09T04:39:21.668317+0000","last_active":"2023-06-09T04:39:21.672884+0000","last_peered":"2023-06-09T04:39:21.672884+0000","last_clean":"2023-06-09T04:39:21.672884+0000","last_became_active":"2023-06-09T04:39:21.667970+0000","last_became_peered":"2023-06-09T04:39:21.667970+0000","last_unstale":"2023-06-09T04:39:21.672884+0000","last_undegraded":"2023-06-09T04:39:21.672884+0000","last_fullsized":"2023-06-09T04:39:21.672884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:36.414062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672802+0000","last_change":"2023-06-09T04:39:21.667632+0000","last_active":"2023-06-09T04:39:21.672802+0000","last_peered":"2023-06-09T04:39:21.672802+0000","last_clean":"2023-06-09T04:39:21.672802+0000","last_became_active":"2023-06-09T04:39:21.667368+0000","last_became_peered":"2023-06-09T04:39:21.667368+0000","last_unstale":"2023-06-09T04:39:21.672802+0000","last_undegraded":"2023-06-09T04:39:21.672802+0000","last_fullsized":"2023-06-09T04:39:21.672802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:32:30.668581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651800+0000","last_change":"2023-06-09T04:39:21.670357+0000","last_active":"2023-06-09T04:39:22.651800+0000","last_peered":"2023-06-09T04:39:22.651800+0000","last_clean":"2023-06-09T04:39:22.651800+0000","last_became_active":"2023-06-09T04:39:21.670081+0000","last_became_peered":"2023-06-09T04:39:21.670081+0000","last_unstale":"2023-06-09T04:39:22.651800+0000","last_undegraded":"2023-06-09T04:39:22.651800+0000","last_fullsized":"2023-06-09T04:39:22.651800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:27:55.658058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651572+0000","last_change":"2023-06-09T04:39:21.668321+0000","last_active":"2023-06-09T04:39:22.651572+0000","last_peered":"2023-06-09T04:39:22.651572+0000","last_clean":"2023-06-09T04:39:22.651572+0000","last_became_active":"2023-06-09T04:39:21.668045+0000","last_became_peered":"2023-06-09T04:39:21.668045+0000","last_unstale":"2023-06-09T04:39:22.651572+0000","last_undegraded":"2023-06-09T04:39:22.651572+0000","last_fullsized":"2023-06-09T04:39:22.651572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:56:20.300372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651994+0000","last_change":"2023-06-09T04:39:21.671287+0000","last_active":"2023-06-09T04:39:22.651994+0000","last_peered":"2023-06-09T04:39:22.651994+0000","last_clean":"2023-06-09T04:39:22.651994+0000","last_became_active":"2023-06-09T04:39:21.670775+0000","last_became_peered":"2023-06-09T04:39:21.670775+0000","last_unstale":"2023-06-09T04:39:22.651994+0000","last_undegraded":"2023-06-09T04:39:22.651994+0000","last_fullsized":"2023-06-09T04:39:22.651994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:14:20.284476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.655956+0000","last_change":"2023-06-09T04:39:21.235422+0000","last_active":"2023-06-09T04:39:21.655956+0000","last_peered":"2023-06-09T04:39:21.655956+0000","last_clean":"2023-06-09T04:39:21.655956+0000","last_became_active":"2023-06-09T04:39:21.234773+0000","last_became_peered":"2023-06-09T04:39:21.234773+0000","last_unstale":"2023-06-09T04:39:21.655956+0000","last_undegraded":"2023-06-09T04:39:21.655956+0000","last_fullsized":"2023-06-09T04:39:21.655956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:41.123556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.652226+0000","last_change":"2023-06-09T04:39:21.237563+0000","last_active":"2023-06-09T04:39:22.652226+0000","last_peered":"2023-06-09T04:39:22.652226+0000","last_clean":"2023-06-09T04:39:22.652226+0000","last_became_active":"2023-06-09T04:39:21.237286+0000","last_became_peered":"2023-06-09T04:39:21.237286+0000","last_unstale":"2023-06-09T04:39:22.652226+0000","last_undegraded":"2023-06-09T04:39:22.652226+0000","last_fullsized":"2023-06-09T04:39:22.652226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:49:08.316992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663683+0000","last_change":"2023-06-09T04:39:21.660730+0000","last_active":"2023-06-09T04:39:21.663683+0000","last_peered":"2023-06-09T04:39:21.663683+0000","last_clean":"2023-06-09T04:39:21.663683+0000","last_became_active":"2023-06-09T04:39:21.660488+0000","last_became_peered":"2023-06-09T04:39:21.660488+0000","last_unstale":"2023-06-09T04:39:21.663683+0000","last_undegraded":"2023-06-09T04:39:21.663683+0000","last_fullsized":"2023-06-09T04:39:21.663683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:49:12.531251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.664196+0000","last_change":"2023-06-09T04:39:21.661840+0000","last_active":"2023-06-09T04:39:21.664196+0000","last_peered":"2023-06-09T04:39:21.664196+0000","last_clean":"2023-06-09T04:39:21.664196+0000","last_became_active":"2023-06-09T04:39:21.661588+0000","last_became_peered":"2023-06-09T04:39:21.661588+0000","last_unstale":"2023-06-09T04:39:21.664196+0000","last_undegraded":"2023-06-09T04:39:21.664196+0000","last_fullsized":"2023-06-09T04:39:21.664196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:27:55.658058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651650+0000","last_change":"2023-06-09T04:39:21.237916+0000","last_active":"2023-06-09T04:39:22.651650+0000","last_peered":"2023-06-09T04:39:22.651650+0000","last_clean":"2023-06-09T04:39:22.651650+0000","last_became_active":"2023-06-09T04:39:21.237693+0000","last_became_peered":"2023-06-09T04:39:21.237693+0000","last_unstale":"2023-06-09T04:39:22.651650+0000","last_undegraded":"2023-06-09T04:39:22.651650+0000","last_fullsized":"2023-06-09T04:39:22.651650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:22.876980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663606+0000","last_change":"2023-06-09T04:39:21.656681+0000","last_active":"2023-06-09T04:39:21.663606+0000","last_peered":"2023-06-09T04:39:21.663606+0000","last_clean":"2023-06-09T04:39:21.663606+0000","last_became_active":"2023-06-09T04:39:21.656390+0000","last_became_peered":"2023-06-09T04:39:21.656390+0000","last_unstale":"2023-06-09T04:39:21.663606+0000","last_undegraded":"2023-06-09T04:39:21.663606+0000","last_fullsized":"2023-06-09T04:39:21.663606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:53:41.547811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673429+0000","last_change":"2023-06-09T04:39:21.671408+0000","last_active":"2023-06-09T04:39:21.673429+0000","last_peered":"2023-06-09T04:39:21.673429+0000","last_clean":"2023-06-09T04:39:21.673429+0000","last_became_active":"2023-06-09T04:39:21.671108+0000","last_became_peered":"2023-06-09T04:39:21.671108+0000","last_unstale":"2023-06-09T04:39:21.673429+0000","last_undegraded":"2023-06-09T04:39:21.673429+0000","last_fullsized":"2023-06-09T04:39:21.673429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:48.574211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.645717+0000","last_change":"2023-06-09T04:39:21.238307+0000","last_active":"2023-06-09T04:39:21.645717+0000","last_peered":"2023-06-09T04:39:21.645717+0000","last_clean":"2023-06-09T04:39:21.645717+0000","last_became_active":"2023-06-09T04:39:21.238007+0000","last_became_peered":"2023-06-09T04:39:21.238007+0000","last_unstale":"2023-06-09T04:39:21.645717+0000","last_undegraded":"2023-06-09T04:39:21.645717+0000","last_fullsized":"2023-06-09T04:39:21.645717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:31.468741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.659640+0000","last_change":"2023-06-09T04:39:21.656478+0000","last_active":"2023-06-09T04:39:21.659640+0000","last_peered":"2023-06-09T04:39:21.659640+0000","last_clean":"2023-06-09T04:39:21.659640+0000","last_became_active":"2023-06-09T04:39:21.656221+0000","last_became_peered":"2023-06-09T04:39:21.656221+0000","last_unstale":"2023-06-09T04:39:21.659640+0000","last_undegraded":"2023-06-09T04:39:21.659640+0000","last_fullsized":"2023-06-09T04:39:21.659640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:47.358550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.675653+0000","last_change":"2023-06-09T04:39:21.241148+0000","last_active":"2023-06-09T04:39:21.675653+0000","last_peered":"2023-06-09T04:39:21.675653+0000","last_clean":"2023-06-09T04:39:21.675653+0000","last_became_active":"2023-06-09T04:39:21.240844+0000","last_became_peered":"2023-06-09T04:39:21.240844+0000","last_unstale":"2023-06-09T04:39:21.675653+0000","last_undegraded":"2023-06-09T04:39:21.675653+0000","last_fullsized":"2023-06-09T04:39:21.675653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:52:12.429689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672463+0000","last_change":"2023-06-09T04:39:21.667897+0000","last_active":"2023-06-09T04:39:21.672463+0000","last_peered":"2023-06-09T04:39:21.672463+0000","last_clean":"2023-06-09T04:39:21.672463+0000","last_became_active":"2023-06-09T04:39:21.667653+0000","last_became_peered":"2023-06-09T04:39:21.667653+0000","last_unstale":"2023-06-09T04:39:21.672463+0000","last_undegraded":"2023-06-09T04:39:21.672463+0000","last_fullsized":"2023-06-09T04:39:21.672463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:56:20.300372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.660599+0000","last_change":"2023-06-09T04:39:21.241947+0000","last_active":"2023-06-09T04:39:21.660599+0000","last_peered":"2023-06-09T04:39:21.660599+0000","last_clean":"2023-06-09T04:39:21.660599+0000","last_became_active":"2023-06-09T04:39:21.241734+0000","last_became_peered":"2023-06-09T04:39:21.241734+0000","last_unstale":"2023-06-09T04:39:21.660599+0000","last_undegraded":"2023-06-09T04:39:21.660599+0000","last_fullsized":"2023-06-09T04:39:21.660599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:51.520504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663256+0000","last_change":"2023-06-09T04:39:21.655706+0000","last_active":"2023-06-09T04:39:21.663256+0000","last_peered":"2023-06-09T04:39:21.663256+0000","last_clean":"2023-06-09T04:39:21.663256+0000","last_became_active":"2023-06-09T04:39:21.655446+0000","last_became_peered":"2023-06-09T04:39:21.655446+0000","last_unstale":"2023-06-09T04:39:21.663256+0000","last_undegraded":"2023-06-09T04:39:21.663256+0000","last_fullsized":"2023-06-09T04:39:21.663256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:13.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651877+0000","last_change":"2023-06-09T04:39:21.237871+0000","last_active":"2023-06-09T04:39:22.651877+0000","last_peered":"2023-06-09T04:39:22.651877+0000","last_clean":"2023-06-09T04:39:22.651877+0000","last_became_active":"2023-06-09T04:39:21.237486+0000","last_became_peered":"2023-06-09T04:39:21.237486+0000","last_unstale":"2023-06-09T04:39:22.651877+0000","last_undegraded":"2023-06-09T04:39:22.651877+0000","last_fullsized":"2023-06-09T04:39:22.651877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:46.353633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663558+0000","last_change":"2023-06-09T04:39:21.655957+0000","last_active":"2023-06-09T04:39:21.663558+0000","last_peered":"2023-06-09T04:39:21.663558+0000","last_clean":"2023-06-09T04:39:21.663558+0000","last_became_active":"2023-06-09T04:39:21.655567+0000","last_became_peered":"2023-06-09T04:39:21.655567+0000","last_unstale":"2023-06-09T04:39:21.663558+0000","last_undegraded":"2023-06-09T04:39:21.663558+0000","last_fullsized":"2023-06-09T04:39:21.663558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:30:02.100385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.655073+0000","last_change":"2023-06-09T04:39:21.652940+0000","last_active":"2023-06-09T04:39:21.655073+0000","last_peered":"2023-06-09T04:39:21.655073+0000","last_clean":"2023-06-09T04:39:21.655073+0000","last_became_active":"2023-06-09T04:39:21.652677+0000","last_became_peered":"2023-06-09T04:39:21.652677+0000","last_unstale":"2023-06-09T04:39:21.655073+0000","last_undegraded":"2023-06-09T04:39:21.655073+0000","last_fullsized":"2023-06-09T04:39:21.655073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:59:25.345303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673533+0000","last_change":"2023-06-09T04:39:21.236585+0000","last_active":"2023-06-09T04:39:21.673533+0000","last_peered":"2023-06-09T04:39:21.673533+0000","last_clean":"2023-06-09T04:39:21.673533+0000","last_became_active":"2023-06-09T04:39:21.236332+0000","last_became_peered":"2023-06-09T04:39:21.236332+0000","last_unstale":"2023-06-09T04:39:21.673533+0000","last_undegraded":"2023-06-09T04:39:21.673533+0000","last_fullsized":"2023-06-09T04:39:21.673533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:10:47.462221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.666805+0000","last_change":"2023-06-09T04:39:21.664366+0000","last_active":"2023-06-09T04:39:21.666805+0000","last_peered":"2023-06-09T04:39:21.666805+0000","last_clean":"2023-06-09T04:39:21.666805+0000","last_became_active":"2023-06-09T04:39:21.664070+0000","last_became_peered":"2023-06-09T04:39:21.664070+0000","last_unstale":"2023-06-09T04:39:21.666805+0000","last_undegraded":"2023-06-09T04:39:21.666805+0000","last_fullsized":"2023-06-09T04:39:21.666805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:01:58.830523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.652056+0000","last_change":"2023-06-09T04:39:21.236879+0000","last_active":"2023-06-09T04:39:22.652056+0000","last_peered":"2023-06-09T04:39:22.652056+0000","last_clean":"2023-06-09T04:39:22.652056+0000","last_became_active":"2023-06-09T04:39:21.236618+0000","last_became_peered":"2023-06-09T04:39:21.236618+0000","last_unstale":"2023-06-09T04:39:22.652056+0000","last_undegraded":"2023-06-09T04:39:22.652056+0000","last_fullsized":"2023-06-09T04:39:22.652056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:41.123556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673227+0000","last_change":"2023-06-09T04:39:21.243888+0000","last_active":"2023-06-09T04:39:21.673227+0000","last_peered":"2023-06-09T04:39:21.673227+0000","last_clean":"2023-06-09T04:39:21.673227+0000","last_became_active":"2023-06-09T04:39:21.243606+0000","last_became_peered":"2023-06-09T04:39:21.243606+0000","last_unstale":"2023-06-09T04:39:21.673227+0000","last_undegraded":"2023-06-09T04:39:21.673227+0000","last_fullsized":"2023-06-09T04:39:21.673227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:44.788382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.659596+0000","last_change":"2023-06-09T04:39:21.655609+0000","last_active":"2023-06-09T04:39:21.659596+0000","last_peered":"2023-06-09T04:39:21.659596+0000","last_clean":"2023-06-09T04:39:21.659596+0000","last_became_active":"2023-06-09T04:39:21.655352+0000","last_became_peered":"2023-06-09T04:39:21.655352+0000","last_unstale":"2023-06-09T04:39:21.659596+0000","last_undegraded":"2023-06-09T04:39:21.659596+0000","last_fullsized":"2023-06-09T04:39:21.659596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:23.881897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.667496+0000","last_change":"2023-06-09T04:39:21.236237+0000","last_active":"2023-06-09T04:39:21.667496+0000","last_peered":"2023-06-09T04:39:21.667496+0000","last_clean":"2023-06-09T04:39:21.667496+0000","last_became_active":"2023-06-09T04:39:21.235945+0000","last_became_peered":"2023-06-09T04:39:21.235945+0000","last_unstale":"2023-06-09T04:39:21.667496+0000","last_undegraded":"2023-06-09T04:39:21.667496+0000","last_fullsized":"2023-06-09T04:39:21.667496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:48.614791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663626+0000","last_change":"2023-06-09T04:39:21.656921+0000","last_active":"2023-06-09T04:39:21.663626+0000","last_peered":"2023-06-09T04:39:21.663626+0000","last_clean":"2023-06-09T04:39:21.663626+0000","last_became_active":"2023-06-09T04:39:21.656311+0000","last_became_peered":"2023-06-09T04:39:21.656311+0000","last_unstale":"2023-06-09T04:39:21.663626+0000","last_undegraded":"2023-06-09T04:39:21.663626+0000","last_fullsized":"2023-06-09T04:39:21.663626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:26.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.666716+0000","last_change":"2023-06-09T04:39:21.244010+0000","last_active":"2023-06-09T04:39:21.666716+0000","last_peered":"2023-06-09T04:39:21.666716+0000","last_clean":"2023-06-09T04:39:21.666716+0000","last_became_active":"2023-06-09T04:39:21.243623+0000","last_became_peered":"2023-06-09T04:39:21.243623+0000","last_unstale":"2023-06-09T04:39:21.666716+0000","last_undegraded":"2023-06-09T04:39:21.666716+0000","last_fullsized":"2023-06-09T04:39:21.666716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:01:15.017763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.405456+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:39:14.405456+0000","last_peered":"2023-06-09T04:39:14.405456+0000","last_clean":"2023-06-09T04:39:14.405456+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:39:14.405456+0000","last_undegraded":"2023-06-09T04:39:14.405456+0000","last_fullsized":"2023-06-09T04:39:14.405456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:50:56.592041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.643190+0000","last_change":"2023-06-09T04:39:21.241143+0000","last_active":"2023-06-09T04:39:21.643190+0000","last_peered":"2023-06-09T04:39:21.643190+0000","last_clean":"2023-06-09T04:39:21.643190+0000","last_became_active":"2023-06-09T04:39:21.240824+0000","last_became_peered":"2023-06-09T04:39:21.240824+0000","last_unstale":"2023-06-09T04:39:21.643190+0000","last_undegraded":"2023-06-09T04:39:21.643190+0000","last_fullsized":"2023-06-09T04:39:21.643190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:05:38.510870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.645310+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:39:21.645310+0000","last_peered":"2023-06-09T04:39:21.645310+0000","last_clean":"2023-06-09T04:39:21.645310+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:39:21.645310+0000","last_undegraded":"2023-06-09T04:39:21.645310+0000","last_fullsized":"2023-06-09T04:39:21.645310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:12.807886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651928+0000","last_change":"2023-06-09T04:39:21.670146+0000","last_active":"2023-06-09T04:39:22.651928+0000","last_peered":"2023-06-09T04:39:22.651928+0000","last_clean":"2023-06-09T04:39:22.651928+0000","last_became_active":"2023-06-09T04:39:21.669851+0000","last_became_peered":"2023-06-09T04:39:21.669851+0000","last_unstale":"2023-06-09T04:39:22.651928+0000","last_undegraded":"2023-06-09T04:39:22.651928+0000","last_fullsized":"2023-06-09T04:39:22.651928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:48.812522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651874+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:39:22.651874+0000","last_peered":"2023-06-09T04:39:22.651874+0000","last_clean":"2023-06-09T04:39:22.651874+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:39:22.651874+0000","last_undegraded":"2023-06-09T04:39:22.651874+0000","last_fullsized":"2023-06-09T04:39:22.651874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:54.801759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.748751+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:39:14.748751+0000","last_peered":"2023-06-09T04:39:14.748751+0000","last_clean":"2023-06-09T04:39:14.748751+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:39:14.748751+0000","last_undegraded":"2023-06-09T04:39:14.748751+0000","last_fullsized":"2023-06-09T04:39:14.748751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:55:03.457806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.670094+0000","last_change":"2023-06-09T04:39:21.235590+0000","last_active":"2023-06-09T04:39:21.670094+0000","last_peered":"2023-06-09T04:39:21.670094+0000","last_clean":"2023-06-09T04:39:21.670094+0000","last_became_active":"2023-06-09T04:39:21.235289+0000","last_became_peered":"2023-06-09T04:39:21.235289+0000","last_unstale":"2023-06-09T04:39:21.670094+0000","last_undegraded":"2023-06-09T04:39:21.670094+0000","last_fullsized":"2023-06-09T04:39:21.670094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:46:06.112315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.748721+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:39:14.748721+0000","last_peered":"2023-06-09T04:39:14.748721+0000","last_clean":"2023-06-09T04:39:14.748721+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:39:14.748721+0000","last_undegraded":"2023-06-09T04:39:14.748721+0000","last_fullsized":"2023-06-09T04:39:14.748721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:03:07.039331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:21.219268+0000","last_change":"2023-06-09T04:39:21.219268+0000","last_active":"2023-06-09T04:39:21.219268+0000","last_peered":"2023-06-09T04:39:21.219268+0000","last_clean":"2023-06-09T04:39:21.219268+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:21.219268+0000","last_undegraded":"2023-06-09T04:39:21.219268+0000","last_fullsized":"2023-06-09T04:39:21.219268+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.748721+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:39:14.748721+0000","last_peered":"2023-06-09T04:39:14.748721+0000","last_clean":"2023-06-09T04:39:14.748721+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:39:14.748721+0000","last_undegraded":"2023-06-09T04:39:14.748721+0000","last_fullsized":"2023-06-09T04:39:14.748721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:49:06.758969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673600+0000","last_change":"2023-06-09T04:39:21.666634+0000","last_active":"2023-06-09T04:39:21.673600+0000","last_peered":"2023-06-09T04:39:21.673600+0000","last_clean":"2023-06-09T04:39:21.673600+0000","last_became_active":"2023-06-09T04:39:21.666338+0000","last_became_peered":"2023-06-09T04:39:21.666338+0000","last_unstale":"2023-06-09T04:39:21.673600+0000","last_undegraded":"2023-06-09T04:39:21.673600+0000","last_fullsized":"2023-06-09T04:39:21.673600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:18.042998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.650563+0000","last_change":"2023-06-09T04:39:21.235445+0000","last_active":"2023-06-09T04:39:21.650563+0000","last_peered":"2023-06-09T04:39:21.650563+0000","last_clean":"2023-06-09T04:39:21.650563+0000","last_became_active":"2023-06-09T04:39:21.234871+0000","last_became_peered":"2023-06-09T04:39:21.234871+0000","last_unstale":"2023-06-09T04:39:21.650563+0000","last_undegraded":"2023-06-09T04:39:21.650563+0000","last_fullsized":"2023-06-09T04:39:21.650563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:14:19.279559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.405456+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:39:14.405456+0000","last_peered":"2023-06-09T04:39:14.405456+0000","last_clean":"2023-06-09T04:39:14.405456+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:39:14.405456+0000","last_undegraded":"2023-06-09T04:39:14.405456+0000","last_fullsized":"2023-06-09T04:39:14.405456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:33.008143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651625+0000","last_change":"2023-06-09T04:39:21.660217+0000","last_active":"2023-06-09T04:39:22.651625+0000","last_peered":"2023-06-09T04:39:22.651625+0000","last_clean":"2023-06-09T04:39:22.651625+0000","last_became_active":"2023-06-09T04:39:21.660039+0000","last_became_peered":"2023-06-09T04:39:21.660039+0000","last_unstale":"2023-06-09T04:39:22.651625+0000","last_undegraded":"2023-06-09T04:39:22.651625+0000","last_fullsized":"2023-06-09T04:39:22.651625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:23.601535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:20.214351+0000","last_change":"2023-06-09T04:39:20.214351+0000","last_active":"2023-06-09T04:39:20.214351+0000","last_peered":"2023-06-09T04:39:20.214351+0000","last_clean":"2023-06-09T04:39:20.214351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:20.214351+0000","last_undegraded":"2023-06-09T04:39:20.214351+0000","last_fullsized":"2023-06-09T04:39:20.214351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.748595+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:39:14.748595+0000","last_peered":"2023-06-09T04:39:14.748595+0000","last_clean":"2023-06-09T04:39:14.748595+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:39:14.748595+0000","last_undegraded":"2023-06-09T04:39:14.748595+0000","last_fullsized":"2023-06-09T04:39:14.748595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:29:32.776486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.659099+0000","last_change":"2023-06-09T04:39:21.653587+0000","last_active":"2023-06-09T04:39:21.659099+0000","last_peered":"2023-06-09T04:39:21.659099+0000","last_clean":"2023-06-09T04:39:21.659099+0000","last_became_active":"2023-06-09T04:39:21.653128+0000","last_became_peered":"2023-06-09T04:39:21.653128+0000","last_unstale":"2023-06-09T04:39:21.659099+0000","last_undegraded":"2023-06-09T04:39:21.659099+0000","last_fullsized":"2023-06-09T04:39:21.659099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:18:14.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.648273+0000","last_change":"2023-06-09T04:39:21.239995+0000","last_active":"2023-06-09T04:39:21.648273+0000","last_peered":"2023-06-09T04:39:21.648273+0000","last_clean":"2023-06-09T04:39:21.648273+0000","last_became_active":"2023-06-09T04:39:21.239713+0000","last_became_peered":"2023-06-09T04:39:21.239713+0000","last_unstale":"2023-06-09T04:39:21.648273+0000","last_undegraded":"2023-06-09T04:39:21.648273+0000","last_fullsized":"2023-06-09T04:39:21.648273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:47.807605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-09T04:39:14.748575+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:39:14.748575+0000","last_peered":"2023-06-09T04:39:14.748575+0000","last_clean":"2023-06-09T04:39:14.748575+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:39:14.748575+0000","last_undegraded":"2023-06-09T04:39:14.748575+0000","last_fullsized":"2023-06-09T04:39:14.748575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:28:27.075017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":937984,"data_stored":727557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.70499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":137189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.434}]},{"osd":4,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":991232,"data_stored":754226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":13.117000000000001,"5min":13.117000000000001,"15min":13.117000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":13.930999999999999,"5min":13.930999999999999,"15min":13.930999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":13.148,"5min":13.148,"15min":13.148},"last":0.315}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":5.9169999999999998,"5min":5.9169999999999998,"15min":5.9169999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":13.977,"5min":13.977,"15min":13.977},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8680000000000003,"5min":5.8680000000000003,"15min":5.8680000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":13.082000000000001,"5min":13.082000000000001,"15min":13.082000000000001},"last":0.497}]},{"osd":6,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":13.042999999999999,"5min":13.042999999999999,"15min":13.042999999999999},"last":0.44},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.8380000000000001,"5min":5.8380000000000001,"15min":5.8380000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":12.927,"5min":12.927,"15min":12.927},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":380928,"data_stored":155988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.24399999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26400000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":380928,"data_stored":156024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.379}]},{"osd":4,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":158713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":15.971,"5min":15.971,"15min":15.971},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":9.266,"5min":9.266,"15min":9.266},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":9.3819999999999997,"5min":9.3819999999999997,"15min":9.3819999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":15.933,"5min":15.933,"15min":15.933},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":9.1549999999999994,"5min":9.1549999999999994,"15min":9.1549999999999994},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.877}]},{"osd":5,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":9.2289999999999992,"5min":9.2289999999999992,"15min":9.2289999999999992},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":9.1910000000000007,"5min":9.1910000000000007,"15min":9.1910000000000007},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":9.3480000000000008,"5min":9.3480000000000008,"15min":9.3480000000000008},"last":0.69699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":137189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.437}]},{"osd":2,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":137189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40000000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.502},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":2.8919999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.377},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:25.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.948+0000 7f7b8737b700 1 Processor -- start 2023-06-09T04:39:25.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.948+0000 7f7b8737b700 1 -- start start 2023-06-09T04:39:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b8737b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b8737b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7b800b07c0 0x7f7b800cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b8737b700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b800cc0f0 con 0x7f7b800caf70 2023-06-09T04:39:25.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b8737b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b800b00a0 con 0x7f7b800b07c0 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b8737b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800cfc20 con 0x7f7b8015d780 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b84916700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7b800b07c0 0x7f7b800cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b85918700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7b800caf70 0x7f7b800ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48986/0 (socket says 172.21.15.26:48986) 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b85918700 1 -- 172.21.15.26:0/1618067433 learned_addr learned my addr 172.21.15.26:0/1618067433 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b85117700 1 --2- 172.21.15.26:0/1618067433 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b84916700 1 -- 172.21.15.26:0/1618067433 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 msgr2=0x7f7b800b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b84916700 1 --2- 172.21.15.26:0/1618067433 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b84916700 1 -- 172.21.15.26:0/1618067433 >> v1:172.21.15.26:6789/0 conn(0x7f7b800caf70 legacy=0x7f7b800ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b77fff700 1 -- 172.21.15.26:0/1618067433 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415048839 0 0) 0x7f7b800cc0f0 con 0x7f7b800caf70 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b84916700 1 -- 172.21.15.26:0/1618067433 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800cb4e0 con 0x7f7b800b07c0 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b84916700 1 --2- 172.21.15.26:0/1618067433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b800cc580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009840 tx=0x7f7b7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d368f029cf3e537c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b77fff700 1 -- 172.21.15.26:0/1618067433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011830 con 0x7f7b800b07c0 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b77fff700 1 -- 172.21.15.26:0/1618067433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c011990 con 0x7f7b800b07c0 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.949+0000 7f7b77fff700 1 -- 172.21.15.26:0/1618067433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011d20 con 0x7f7b800b07c0 2023-06-09T04:39:25.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 -- 172.21.15.26:0/1618067433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 msgr2=0x7f7b800cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 --2- 172.21.15.26:0/1618067433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b800cc580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009840 tx=0x7f7b7c009b50 comp rx=0 tx=0).stop 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 -- 172.21.15.26:0/1618067433 shutdown_connections 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 --2- 172.21.15.26:0/1618067433 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 --2- 172.21.15.26:0/1618067433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b800cc580 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 -- 172.21.15.26:0/1618067433 >> 172.21.15.26:0/1618067433 conn(0x7f7b80089fc0 msgr2=0x7f7b800d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 -- 172.21.15.26:0/1618067433 shutdown_connections 2023-06-09T04:39:25.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.950+0000 7f7b8737b700 1 -- 172.21.15.26:0/1618067433 wait complete. 2023-06-09T04:39:25.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.951+0000 7f7b8737b700 1 Processor -- start 2023-06-09T04:39:25.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.951+0000 7f7b8737b700 1 -- start start 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b8737b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b80156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b8737b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b800caf70 0x7f7b800b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b8737b700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b8737b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800b4d20 con 0x7f7b800b07c0 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b8737b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800c4c10 con 0x7f7b800caf70 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b8737b700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800c4930 con 0x7f7b8015d780 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b85117700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b80156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b85117700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b80156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40130/0 (socket says 172.21.15.26:40130) 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b85117700 1 -- 172.21.15.26:0/3819169484 learned_addr learned my addr 172.21.15.26:0/3819169484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b85918700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b85117700 1 -- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 msgr2=0x7f7b800adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.952+0000 7f7b85117700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b85117700 1 -- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b800caf70 msgr2=0x7f7b800b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b85117700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b800caf70 0x7f7b800b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b85117700 1 -- 172.21.15.26:0/3819169484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0094a0 con 0x7f7b800b07c0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b85918700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b85117700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b80156990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000d7d0 tx=0x7f7b7000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700125f0 con 0x7f7b800b07c0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70012750 con 0x7f7b800b07c0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b800b4f00 con 0x7f7b800b07c0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70012b00 con 0x7f7b800b07c0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.953+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b800b54c0 con 0x7f7b800b07c0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.954+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8008a390 con 0x7f7b800b07c0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.954+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b70012c60 con 0x7f7b800b07c0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.955+0000 7f7b75ffb700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7b6406ace0 0x7f7b6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.955+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b70089630 con 0x7f7b800b07c0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.955+0000 7f7b84916700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7b6406ace0 0x7f7b6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.956+0000 7f7b84916700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7b6406ace0 0x7f7b6406d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b800c3f00 tx=0x7f7b7c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:25.959+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b70054640 con 0x7f7b800b07c0 2023-06-09T04:39:26.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.156+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 --> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b800cbaa0 con 0x7f7b6406ace0 2023-06-09T04:39:26.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.165+0000 7f7b75ffb700 1 -- 172.21.15.26:0/3819169484 <== mgr.4108 v2:172.21.15.104:6832/83486613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312181 (secure 0 0 0) 0x7f7b7c01f070 con 0x7f7b6406ace0 2023-06-09T04:39:26.169 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:26.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7b6406ace0 msgr2=0x7f7b6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7b6406ace0 0x7f7b6406d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b800c3f00 tx=0x7f7b7c010000 comp rx=0 tx=0).stop 2023-06-09T04:39:26.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 msgr2=0x7f7b80156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b80156990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000d7d0 tx=0x7f7b7000db90 comp rx=0 tx=0).stop 2023-06-09T04:39:26.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 shutdown_connections 2023-06-09T04:39:26.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7b8015d780 0x7f7b800adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f7b6406ace0 0x7f7b6406d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7b800b07c0 0x7f7b80156990 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 --2- 172.21.15.26:0/3819169484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b800caf70 0x7f7b800b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 >> 172.21.15.26:0/3819169484 conn(0x7f7b80089fc0 msgr2=0x7f7b800af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 shutdown_connections 2023-06-09T04:39:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.168+0000 7f7b8737b700 1 -- 172.21.15.26:0/3819169484 wait complete. 2023-06-09T04:39:26.172 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-06-09T04:39:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-06-09T04:39:25.892115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219868,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754852,"statfs":{"total":773094113280,"available":772868968448,"internally_reserved":0,"allocated":4354048,"data_stored":2473323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672100"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663565+0000","last_change":"2023-06-09T04:39:21.656640+0000","last_active":"2023-06-09T04:39:21.663565+0000","last_peered":"2023-06-09T04:39:21.663565+0000","last_clean":"2023-06-09T04:39:21.663565+0000","last_became_active":"2023-06-09T04:39:21.656327+0000","last_became_peered":"2023-06-09T04:39:21.656327+0000","last_unstale":"2023-06-09T04:39:21.663565+0000","last_undegraded":"2023-06-09T04:39:21.663565+0000","last_fullsized":"2023-06-09T04:39:21.663565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:15:42.641330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673621+0000","last_change":"2023-06-09T04:39:21.667684+0000","last_active":"2023-06-09T04:39:21.673621+0000","last_peered":"2023-06-09T04:39:21.673621+0000","last_clean":"2023-06-09T04:39:21.673621+0000","last_became_active":"2023-06-09T04:39:21.667405+0000","last_became_peered":"2023-06-09T04:39:21.667405+0000","last_unstale":"2023-06-09T04:39:21.673621+0000","last_undegraded":"2023-06-09T04:39:21.673621+0000","last_fullsized":"2023-06-09T04:39:21.673621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:26:28.646322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.665154+0000","last_change":"2023-06-09T04:39:21.664282+0000","last_active":"2023-06-09T04:39:21.665154+0000","last_peered":"2023-06-09T04:39:21.665154+0000","last_clean":"2023-06-09T04:39:21.665154+0000","last_became_active":"2023-06-09T04:39:21.663967+0000","last_became_peered":"2023-06-09T04:39:21.663967+0000","last_unstale":"2023-06-09T04:39:21.665154+0000","last_undegraded":"2023-06-09T04:39:21.665154+0000","last_fullsized":"2023-06-09T04:39:21.665154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:49:11.644325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673470+0000","last_change":"2023-06-09T04:39:21.671769+0000","last_active":"2023-06-09T04:39:21.673470+0000","last_peered":"2023-06-09T04:39:21.673470+0000","last_clean":"2023-06-09T04:39:21.673470+0000","last_became_active":"2023-06-09T04:39:21.671502+0000","last_became_peered":"2023-06-09T04:39:21.671502+0000","last_unstale":"2023-06-09T04:39:21.673470+0000","last_undegraded":"2023-06-09T04:39:21.673470+0000","last_fullsized":"2023-06-09T04:39:21.673470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:48.864987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673495+0000","last_change":"2023-06-09T04:39:21.671424+0000","last_active":"2023-06-09T04:39:21.673495+0000","last_peered":"2023-06-09T04:39:21.673495+0000","last_clean":"2023-06-09T04:39:21.673495+0000","last_became_active":"2023-06-09T04:39:21.671159+0000","last_became_peered":"2023-06-09T04:39:21.671159+0000","last_unstale":"2023-06-09T04:39:21.673495+0000","last_undegraded":"2023-06-09T04:39:21.673495+0000","last_fullsized":"2023-06-09T04:39:21.673495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:42:11.603090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651753+0000","last_change":"2023-06-09T04:39:21.662768+0000","last_active":"2023-06-09T04:39:22.651753+0000","last_peered":"2023-06-09T04:39:22.651753+0000","last_clean":"2023-06-09T04:39:22.651753+0000","last_became_active":"2023-06-09T04:39:21.662556+0000","last_became_peered":"2023-06-09T04:39:21.662556+0000","last_unstale":"2023-06-09T04:39:22.651753+0000","last_undegraded":"2023-06-09T04:39:22.651753+0000","last_fullsized":"2023-06-09T04:39:22.651753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:09:18.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658178+0000","last_change":"2023-06-09T04:39:21.663388+0000","last_active":"2023-06-09T04:39:22.658178+0000","last_peered":"2023-06-09T04:39:22.658178+0000","last_clean":"2023-06-09T04:39:22.658178+0000","last_became_active":"2023-06-09T04:39:21.663078+0000","last_became_peered":"2023-06-09T04:39:21.663078+0000","last_unstale":"2023-06-09T04:39:22.658178+0000","last_undegraded":"2023-06-09T04:39:22.658178+0000","last_fullsized":"2023-06-09T04:39:22.658178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:13.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673683+0000","last_change":"2023-06-09T04:39:21.668565+0000","last_active":"2023-06-09T04:39:21.673683+0000","last_peered":"2023-06-09T04:39:21.673683+0000","last_clean":"2023-06-09T04:39:21.673683+0000","last_became_active":"2023-06-09T04:39:21.668307+0000","last_became_peered":"2023-06-09T04:39:21.668307+0000","last_unstale":"2023-06-09T04:39:21.673683+0000","last_undegraded":"2023-06-09T04:39:21.673683+0000","last_fullsized":"2023-06-09T04:39:21.673683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:51:00.140813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672320+0000","last_change":"2023-06-09T04:39:21.668549+0000","last_active":"2023-06-09T04:39:21.672320+0000","last_peered":"2023-06-09T04:39:21.672320+0000","last_clean":"2023-06-09T04:39:21.672320+0000","last_became_active":"2023-06-09T04:39:21.668311+0000","last_became_peered":"2023-06-09T04:39:21.668311+0000","last_unstale":"2023-06-09T04:39:21.672320+0000","last_undegraded":"2023-06-09T04:39:21.672320+0000","last_fullsized":"2023-06-09T04:39:21.672320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:23.601535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658516+0000","last_change":"2023-06-09T04:39:21.667513+0000","last_active":"2023-06-09T04:39:22.658516+0000","last_peered":"2023-06-09T04:39:22.658516+0000","last_clean":"2023-06-09T04:39:22.658516+0000","last_became_active":"2023-06-09T04:39:21.667262+0000","last_became_peered":"2023-06-09T04:39:21.667262+0000","last_unstale":"2023-06-09T04:39:22.658516+0000","last_undegraded":"2023-06-09T04:39:22.658516+0000","last_fullsized":"2023-06-09T04:39:22.658516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:49:12.531251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658472+0000","last_change":"2023-06-09T04:39:21.668558+0000","last_active":"2023-06-09T04:39:22.658472+0000","last_peered":"2023-06-09T04:39:22.658472+0000","last_clean":"2023-06-09T04:39:22.658472+0000","last_became_active":"2023-06-09T04:39:21.667746+0000","last_became_peered":"2023-06-09T04:39:21.667746+0000","last_unstale":"2023-06-09T04:39:22.658472+0000","last_undegraded":"2023-06-09T04:39:22.658472+0000","last_fullsized":"2023-06-09T04:39:22.658472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:03:29.650452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672344+0000","last_change":"2023-06-09T04:39:21.669449+0000","last_active":"2023-06-09T04:39:21.672344+0000","last_peered":"2023-06-09T04:39:21.672344+0000","last_clean":"2023-06-09T04:39:21.672344+0000","last_became_active":"2023-06-09T04:39:21.669107+0000","last_became_peered":"2023-06-09T04:39:21.669107+0000","last_unstale":"2023-06-09T04:39:21.672344+0000","last_undegraded":"2023-06-09T04:39:21.672344+0000","last_fullsized":"2023-06-09T04:39:21.672344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:09:18.771431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658053+0000","last_change":"2023-06-09T04:39:21.663611+0000","last_active":"2023-06-09T04:39:22.658053+0000","last_peered":"2023-06-09T04:39:22.658053+0000","last_clean":"2023-06-09T04:39:22.658053+0000","last_became_active":"2023-06-09T04:39:21.663272+0000","last_became_peered":"2023-06-09T04:39:21.663272+0000","last_unstale":"2023-06-09T04:39:22.658053+0000","last_undegraded":"2023-06-09T04:39:22.658053+0000","last_fullsized":"2023-06-09T04:39:22.658053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:51:00.140813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657095+0000","last_change":"2023-06-09T04:39:21.665414+0000","last_active":"2023-06-09T04:39:22.657095+0000","last_peered":"2023-06-09T04:39:22.657095+0000","last_clean":"2023-06-09T04:39:22.657095+0000","last_became_active":"2023-06-09T04:39:21.665174+0000","last_became_peered":"2023-06-09T04:39:21.665174+0000","last_unstale":"2023-06-09T04:39:22.657095+0000","last_undegraded":"2023-06-09T04:39:22.657095+0000","last_fullsized":"2023-06-09T04:39:22.657095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:12:57.862297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658175+0000","last_change":"2023-06-09T04:39:21.668118+0000","last_active":"2023-06-09T04:39:22.658175+0000","last_peered":"2023-06-09T04:39:22.658175+0000","last_clean":"2023-06-09T04:39:22.658175+0000","last_became_active":"2023-06-09T04:39:21.667847+0000","last_became_peered":"2023-06-09T04:39:21.667847+0000","last_unstale":"2023-06-09T04:39:22.658175+0000","last_undegraded":"2023-06-09T04:39:22.658175+0000","last_fullsized":"2023-06-09T04:39:22.658175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:30:02.100385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159701+0000","last_change":"2023-06-09T04:39:21.662938+0000","last_active":"2023-06-09T04:39:23.159701+0000","last_peered":"2023-06-09T04:39:23.159701+0000","last_clean":"2023-06-09T04:39:23.159701+0000","last_became_active":"2023-06-09T04:39:21.662674+0000","last_became_peered":"2023-06-09T04:39:21.662674+0000","last_unstale":"2023-06-09T04:39:23.159701+0000","last_undegraded":"2023-06-09T04:39:23.159701+0000","last_fullsized":"2023-06-09T04:39:23.159701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:49:12.531251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160577+0000","last_change":"2023-06-09T04:39:21.667616+0000","last_active":"2023-06-09T04:39:23.160577+0000","last_peered":"2023-06-09T04:39:23.160577+0000","last_clean":"2023-06-09T04:39:23.160577+0000","last_became_active":"2023-06-09T04:39:21.667212+0000","last_became_peered":"2023-06-09T04:39:21.667212+0000","last_unstale":"2023-06-09T04:39:23.160577+0000","last_undegraded":"2023-06-09T04:39:23.160577+0000","last_fullsized":"2023-06-09T04:39:23.160577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:07:50.115361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160402+0000","last_change":"2023-06-09T04:39:21.665616+0000","last_active":"2023-06-09T04:39:23.160402+0000","last_peered":"2023-06-09T04:39:23.160402+0000","last_clean":"2023-06-09T04:39:23.160402+0000","last_became_active":"2023-06-09T04:39:21.665345+0000","last_became_peered":"2023-06-09T04:39:21.665345+0000","last_unstale":"2023-06-09T04:39:23.160402+0000","last_undegraded":"2023-06-09T04:39:23.160402+0000","last_fullsized":"2023-06-09T04:39:23.160402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:53:59.485592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672884+0000","last_change":"2023-06-09T04:39:21.668317+0000","last_active":"2023-06-09T04:39:21.672884+0000","last_peered":"2023-06-09T04:39:21.672884+0000","last_clean":"2023-06-09T04:39:21.672884+0000","last_became_active":"2023-06-09T04:39:21.667970+0000","last_became_peered":"2023-06-09T04:39:21.667970+0000","last_unstale":"2023-06-09T04:39:21.672884+0000","last_undegraded":"2023-06-09T04:39:21.672884+0000","last_fullsized":"2023-06-09T04:39:21.672884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:36.414062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160046+0000","last_change":"2023-06-09T04:39:21.665430+0000","last_active":"2023-06-09T04:39:23.160046+0000","last_peered":"2023-06-09T04:39:23.160046+0000","last_clean":"2023-06-09T04:39:23.160046+0000","last_became_active":"2023-06-09T04:39:21.665144+0000","last_became_peered":"2023-06-09T04:39:21.665144+0000","last_unstale":"2023-06-09T04:39:23.160046+0000","last_undegraded":"2023-06-09T04:39:23.160046+0000","last_fullsized":"2023-06-09T04:39:23.160046+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:31.159881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658225+0000","last_change":"2023-06-09T04:39:21.663241+0000","last_active":"2023-06-09T04:39:22.658225+0000","last_peered":"2023-06-09T04:39:22.658225+0000","last_clean":"2023-06-09T04:39:22.658225+0000","last_became_active":"2023-06-09T04:39:21.662940+0000","last_became_peered":"2023-06-09T04:39:21.662940+0000","last_unstale":"2023-06-09T04:39:22.658225+0000","last_undegraded":"2023-06-09T04:39:22.658225+0000","last_fullsized":"2023-06-09T04:39:22.658225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:53:41.547811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.656625+0000","last_change":"2023-06-09T04:39:21.665938+0000","last_active":"2023-06-09T04:39:22.656625+0000","last_peered":"2023-06-09T04:39:22.656625+0000","last_clean":"2023-06-09T04:39:22.656625+0000","last_became_active":"2023-06-09T04:39:21.665614+0000","last_became_peered":"2023-06-09T04:39:21.665614+0000","last_unstale":"2023-06-09T04:39:22.656625+0000","last_undegraded":"2023-06-09T04:39:22.656625+0000","last_fullsized":"2023-06-09T04:39:22.656625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:22:38.736688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160696+0000","last_change":"2023-06-09T04:39:21.660420+0000","last_active":"2023-06-09T04:39:23.160696+0000","last_peered":"2023-06-09T04:39:23.160696+0000","last_clean":"2023-06-09T04:39:23.160696+0000","last_became_active":"2023-06-09T04:39:21.660161+0000","last_became_peered":"2023-06-09T04:39:21.660161+0000","last_unstale":"2023-06-09T04:39:23.160696+0000","last_undegraded":"2023-06-09T04:39:23.160696+0000","last_fullsized":"2023-06-09T04:39:23.160696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:49:12.839329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672802+0000","last_change":"2023-06-09T04:39:21.667632+0000","last_active":"2023-06-09T04:39:21.672802+0000","last_peered":"2023-06-09T04:39:21.672802+0000","last_clean":"2023-06-09T04:39:21.672802+0000","last_became_active":"2023-06-09T04:39:21.667368+0000","last_became_peered":"2023-06-09T04:39:21.667368+0000","last_unstale":"2023-06-09T04:39:21.672802+0000","last_undegraded":"2023-06-09T04:39:21.672802+0000","last_fullsized":"2023-06-09T04:39:21.672802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:32:30.668581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160400+0000","last_change":"2023-06-09T04:39:21.656837+0000","last_active":"2023-06-09T04:39:23.160400+0000","last_peered":"2023-06-09T04:39:23.160400+0000","last_clean":"2023-06-09T04:39:23.160400+0000","last_became_active":"2023-06-09T04:39:21.656289+0000","last_became_peered":"2023-06-09T04:39:21.656289+0000","last_unstale":"2023-06-09T04:39:23.160400+0000","last_undegraded":"2023-06-09T04:39:23.160400+0000","last_fullsized":"2023-06-09T04:39:23.160400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:49.850709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651800+0000","last_change":"2023-06-09T04:39:21.670357+0000","last_active":"2023-06-09T04:39:22.651800+0000","last_peered":"2023-06-09T04:39:22.651800+0000","last_clean":"2023-06-09T04:39:22.651800+0000","last_became_active":"2023-06-09T04:39:21.670081+0000","last_became_peered":"2023-06-09T04:39:21.670081+0000","last_unstale":"2023-06-09T04:39:22.651800+0000","last_undegraded":"2023-06-09T04:39:22.651800+0000","last_fullsized":"2023-06-09T04:39:22.651800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:27:55.658058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160295+0000","last_change":"2023-06-09T04:39:21.668904+0000","last_active":"2023-06-09T04:39:23.160295+0000","last_peered":"2023-06-09T04:39:23.160295+0000","last_clean":"2023-06-09T04:39:23.160295+0000","last_became_active":"2023-06-09T04:39:21.668561+0000","last_became_peered":"2023-06-09T04:39:21.668561+0000","last_unstale":"2023-06-09T04:39:23.160295+0000","last_undegraded":"2023-06-09T04:39:23.160295+0000","last_fullsized":"2023-06-09T04:39:23.160295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:37.642764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658185+0000","last_change":"2023-06-09T04:39:21.664656+0000","last_active":"2023-06-09T04:39:22.658185+0000","last_peered":"2023-06-09T04:39:22.658185+0000","last_clean":"2023-06-09T04:39:22.658185+0000","last_became_active":"2023-06-09T04:39:21.664370+0000","last_became_peered":"2023-06-09T04:39:21.664370+0000","last_unstale":"2023-06-09T04:39:22.658185+0000","last_undegraded":"2023-06-09T04:39:22.658185+0000","last_fullsized":"2023-06-09T04:39:22.658185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:26.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159701+0000","last_change":"2023-06-09T04:39:21.659963+0000","last_active":"2023-06-09T04:39:23.159701+0000","last_peered":"2023-06-09T04:39:23.159701+0000","last_clean":"2023-06-09T04:39:23.159701+0000","last_became_active":"2023-06-09T04:39:21.659642+0000","last_became_peered":"2023-06-09T04:39:21.659642+0000","last_unstale":"2023-06-09T04:39:23.159701+0000","last_undegraded":"2023-06-09T04:39:23.159701+0000","last_fullsized":"2023-06-09T04:39:23.159701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:28.049772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159770+0000","last_change":"2023-06-09T04:39:21.653285+0000","last_active":"2023-06-09T04:39:23.159770+0000","last_peered":"2023-06-09T04:39:23.159770+0000","last_clean":"2023-06-09T04:39:23.159770+0000","last_became_active":"2023-06-09T04:39:21.652195+0000","last_became_peered":"2023-06-09T04:39:21.652195+0000","last_unstale":"2023-06-09T04:39:23.159770+0000","last_undegraded":"2023-06-09T04:39:23.159770+0000","last_fullsized":"2023-06-09T04:39:23.159770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:37:54.089584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160611+0000","last_change":"2023-06-09T04:39:21.667798+0000","last_active":"2023-06-09T04:39:23.160611+0000","last_peered":"2023-06-09T04:39:23.160611+0000","last_clean":"2023-06-09T04:39:23.160611+0000","last_became_active":"2023-06-09T04:39:21.667561+0000","last_became_peered":"2023-06-09T04:39:21.667561+0000","last_unstale":"2023-06-09T04:39:23.160611+0000","last_undegraded":"2023-06-09T04:39:23.160611+0000","last_fullsized":"2023-06-09T04:39:23.160611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:55.502925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651572+0000","last_change":"2023-06-09T04:39:21.668321+0000","last_active":"2023-06-09T04:39:22.651572+0000","last_peered":"2023-06-09T04:39:22.651572+0000","last_clean":"2023-06-09T04:39:22.651572+0000","last_became_active":"2023-06-09T04:39:21.668045+0000","last_became_peered":"2023-06-09T04:39:21.668045+0000","last_unstale":"2023-06-09T04:39:22.651572+0000","last_undegraded":"2023-06-09T04:39:22.651572+0000","last_fullsized":"2023-06-09T04:39:22.651572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:56:20.300372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159874+0000","last_change":"2023-06-09T04:39:21.667536+0000","last_active":"2023-06-09T04:39:23.159874+0000","last_peered":"2023-06-09T04:39:23.159874+0000","last_clean":"2023-06-09T04:39:23.159874+0000","last_became_active":"2023-06-09T04:39:21.667200+0000","last_became_peered":"2023-06-09T04:39:21.667200+0000","last_unstale":"2023-06-09T04:39:23.159874+0000","last_undegraded":"2023-06-09T04:39:23.159874+0000","last_fullsized":"2023-06-09T04:39:23.159874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:26:28.646322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160672+0000","last_change":"2023-06-09T04:39:21.238173+0000","last_active":"2023-06-09T04:39:23.160672+0000","last_peered":"2023-06-09T04:39:23.160672+0000","last_clean":"2023-06-09T04:39:23.160672+0000","last_became_active":"2023-06-09T04:39:21.237904+0000","last_became_peered":"2023-06-09T04:39:21.237904+0000","last_unstale":"2023-06-09T04:39:23.160672+0000","last_undegraded":"2023-06-09T04:39:23.160672+0000","last_fullsized":"2023-06-09T04:39:23.160672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:04:28.613720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651994+0000","last_change":"2023-06-09T04:39:21.671287+0000","last_active":"2023-06-09T04:39:22.651994+0000","last_peered":"2023-06-09T04:39:22.651994+0000","last_clean":"2023-06-09T04:39:22.651994+0000","last_became_active":"2023-06-09T04:39:21.670775+0000","last_became_peered":"2023-06-09T04:39:21.670775+0000","last_unstale":"2023-06-09T04:39:22.651994+0000","last_undegraded":"2023-06-09T04:39:22.651994+0000","last_fullsized":"2023-06-09T04:39:22.651994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:14:20.284476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.655956+0000","last_change":"2023-06-09T04:39:21.235422+0000","last_active":"2023-06-09T04:39:21.655956+0000","last_peered":"2023-06-09T04:39:21.655956+0000","last_clean":"2023-06-09T04:39:21.655956+0000","last_became_active":"2023-06-09T04:39:21.234773+0000","last_became_peered":"2023-06-09T04:39:21.234773+0000","last_unstale":"2023-06-09T04:39:21.655956+0000","last_undegraded":"2023-06-09T04:39:21.655956+0000","last_fullsized":"2023-06-09T04:39:21.655956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:41.123556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657143+0000","last_change":"2023-06-09T04:39:21.665388+0000","last_active":"2023-06-09T04:39:22.657143+0000","last_peered":"2023-06-09T04:39:22.657143+0000","last_clean":"2023-06-09T04:39:22.657143+0000","last_became_active":"2023-06-09T04:39:21.665111+0000","last_became_peered":"2023-06-09T04:39:21.665111+0000","last_unstale":"2023-06-09T04:39:22.657143+0000","last_undegraded":"2023-06-09T04:39:22.657143+0000","last_fullsized":"2023-06-09T04:39:22.657143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:00:26.365479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.652226+0000","last_change":"2023-06-09T04:39:21.237563+0000","last_active":"2023-06-09T04:39:22.652226+0000","last_peered":"2023-06-09T04:39:22.652226+0000","last_clean":"2023-06-09T04:39:22.652226+0000","last_became_active":"2023-06-09T04:39:21.237286+0000","last_became_peered":"2023-06-09T04:39:21.237286+0000","last_unstale":"2023-06-09T04:39:22.652226+0000","last_undegraded":"2023-06-09T04:39:22.652226+0000","last_fullsized":"2023-06-09T04:39:22.652226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:49:08.316992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663683+0000","last_change":"2023-06-09T04:39:21.660730+0000","last_active":"2023-06-09T04:39:21.663683+0000","last_peered":"2023-06-09T04:39:21.663683+0000","last_clean":"2023-06-09T04:39:21.663683+0000","last_became_active":"2023-06-09T04:39:21.660488+0000","last_became_peered":"2023-06-09T04:39:21.660488+0000","last_unstale":"2023-06-09T04:39:21.663683+0000","last_undegraded":"2023-06-09T04:39:21.663683+0000","last_fullsized":"2023-06-09T04:39:21.663683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:49:12.531251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.656959+0000","last_change":"2023-06-09T04:39:21.241523+0000","last_active":"2023-06-09T04:39:22.656959+0000","last_peered":"2023-06-09T04:39:22.656959+0000","last_clean":"2023-06-09T04:39:22.656959+0000","last_became_active":"2023-06-09T04:39:21.241229+0000","last_became_peered":"2023-06-09T04:39:21.241229+0000","last_unstale":"2023-06-09T04:39:22.656959+0000","last_undegraded":"2023-06-09T04:39:22.656959+0000","last_fullsized":"2023-06-09T04:39:22.656959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:05:08.799840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.664196+0000","last_change":"2023-06-09T04:39:21.661840+0000","last_active":"2023-06-09T04:39:21.664196+0000","last_peered":"2023-06-09T04:39:21.664196+0000","last_clean":"2023-06-09T04:39:21.664196+0000","last_became_active":"2023-06-09T04:39:21.661588+0000","last_became_peered":"2023-06-09T04:39:21.661588+0000","last_unstale":"2023-06-09T04:39:21.664196+0000","last_undegraded":"2023-06-09T04:39:21.664196+0000","last_fullsized":"2023-06-09T04:39:21.664196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:27:55.658058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658215+0000","last_change":"2023-06-09T04:39:21.239752+0000","last_active":"2023-06-09T04:39:22.658215+0000","last_peered":"2023-06-09T04:39:22.658215+0000","last_clean":"2023-06-09T04:39:22.658215+0000","last_became_active":"2023-06-09T04:39:21.239411+0000","last_became_peered":"2023-06-09T04:39:21.239411+0000","last_unstale":"2023-06-09T04:39:22.658215+0000","last_undegraded":"2023-06-09T04:39:22.658215+0000","last_fullsized":"2023-06-09T04:39:22.658215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:51.520504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657931+0000","last_change":"2023-06-09T04:39:21.667262+0000","last_active":"2023-06-09T04:39:22.657931+0000","last_peered":"2023-06-09T04:39:22.657931+0000","last_clean":"2023-06-09T04:39:22.657931+0000","last_became_active":"2023-06-09T04:39:21.666967+0000","last_became_peered":"2023-06-09T04:39:21.666967+0000","last_unstale":"2023-06-09T04:39:22.657931+0000","last_undegraded":"2023-06-09T04:39:22.657931+0000","last_fullsized":"2023-06-09T04:39:22.657931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:00:04.548222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160414+0000","last_change":"2023-06-09T04:39:21.241583+0000","last_active":"2023-06-09T04:39:23.160414+0000","last_peered":"2023-06-09T04:39:23.160414+0000","last_clean":"2023-06-09T04:39:23.160414+0000","last_became_active":"2023-06-09T04:39:21.241099+0000","last_became_peered":"2023-06-09T04:39:21.241099+0000","last_unstale":"2023-06-09T04:39:23.160414+0000","last_undegraded":"2023-06-09T04:39:23.160414+0000","last_fullsized":"2023-06-09T04:39:23.160414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:34.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.656818+0000","last_change":"2023-06-09T04:39:21.668165+0000","last_active":"2023-06-09T04:39:22.656818+0000","last_peered":"2023-06-09T04:39:22.656818+0000","last_clean":"2023-06-09T04:39:22.656818+0000","last_became_active":"2023-06-09T04:39:21.667901+0000","last_became_peered":"2023-06-09T04:39:21.667901+0000","last_unstale":"2023-06-09T04:39:22.656818+0000","last_undegraded":"2023-06-09T04:39:22.656818+0000","last_fullsized":"2023-06-09T04:39:22.656818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:11:15.972152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651650+0000","last_change":"2023-06-09T04:39:21.237916+0000","last_active":"2023-06-09T04:39:22.651650+0000","last_peered":"2023-06-09T04:39:22.651650+0000","last_clean":"2023-06-09T04:39:22.651650+0000","last_became_active":"2023-06-09T04:39:21.237693+0000","last_became_peered":"2023-06-09T04:39:21.237693+0000","last_unstale":"2023-06-09T04:39:22.651650+0000","last_undegraded":"2023-06-09T04:39:22.651650+0000","last_fullsized":"2023-06-09T04:39:22.651650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:22.876980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663606+0000","last_change":"2023-06-09T04:39:21.656681+0000","last_active":"2023-06-09T04:39:21.663606+0000","last_peered":"2023-06-09T04:39:21.663606+0000","last_clean":"2023-06-09T04:39:21.663606+0000","last_became_active":"2023-06-09T04:39:21.656390+0000","last_became_peered":"2023-06-09T04:39:21.656390+0000","last_unstale":"2023-06-09T04:39:21.663606+0000","last_undegraded":"2023-06-09T04:39:21.663606+0000","last_fullsized":"2023-06-09T04:39:21.663606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:53:41.547811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.656471+0000","last_change":"2023-06-09T04:39:21.237005+0000","last_active":"2023-06-09T04:39:22.656471+0000","last_peered":"2023-06-09T04:39:22.656471+0000","last_clean":"2023-06-09T04:39:22.656471+0000","last_became_active":"2023-06-09T04:39:21.235990+0000","last_became_peered":"2023-06-09T04:39:21.235990+0000","last_unstale":"2023-06-09T04:39:22.656471+0000","last_undegraded":"2023-06-09T04:39:22.656471+0000","last_fullsized":"2023-06-09T04:39:22.656471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:28:47.377778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673429+0000","last_change":"2023-06-09T04:39:21.671408+0000","last_active":"2023-06-09T04:39:21.673429+0000","last_peered":"2023-06-09T04:39:21.673429+0000","last_clean":"2023-06-09T04:39:21.673429+0000","last_became_active":"2023-06-09T04:39:21.671108+0000","last_became_peered":"2023-06-09T04:39:21.671108+0000","last_unstale":"2023-06-09T04:39:21.673429+0000","last_undegraded":"2023-06-09T04:39:21.673429+0000","last_fullsized":"2023-06-09T04:39:21.673429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:48.574211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.645717+0000","last_change":"2023-06-09T04:39:21.238307+0000","last_active":"2023-06-09T04:39:21.645717+0000","last_peered":"2023-06-09T04:39:21.645717+0000","last_clean":"2023-06-09T04:39:21.645717+0000","last_became_active":"2023-06-09T04:39:21.238007+0000","last_became_peered":"2023-06-09T04:39:21.238007+0000","last_unstale":"2023-06-09T04:39:21.645717+0000","last_undegraded":"2023-06-09T04:39:21.645717+0000","last_fullsized":"2023-06-09T04:39:21.645717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:31.468741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160340+0000","last_change":"2023-06-09T04:39:21.658824+0000","last_active":"2023-06-09T04:39:23.160340+0000","last_peered":"2023-06-09T04:39:23.160340+0000","last_clean":"2023-06-09T04:39:23.160340+0000","last_became_active":"2023-06-09T04:39:21.658562+0000","last_became_peered":"2023-06-09T04:39:21.658562+0000","last_unstale":"2023-06-09T04:39:23.160340+0000","last_undegraded":"2023-06-09T04:39:23.160340+0000","last_fullsized":"2023-06-09T04:39:23.160340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:54.866237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658600+0000","last_change":"2023-06-09T04:39:21.242330+0000","last_active":"2023-06-09T04:39:22.658600+0000","last_peered":"2023-06-09T04:39:22.658600+0000","last_clean":"2023-06-09T04:39:22.658600+0000","last_became_active":"2023-06-09T04:39:21.242010+0000","last_became_peered":"2023-06-09T04:39:21.242010+0000","last_unstale":"2023-06-09T04:39:22.658600+0000","last_undegraded":"2023-06-09T04:39:22.658600+0000","last_fullsized":"2023-06-09T04:39:22.658600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:31.468741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.659640+0000","last_change":"2023-06-09T04:39:21.656478+0000","last_active":"2023-06-09T04:39:21.659640+0000","last_peered":"2023-06-09T04:39:21.659640+0000","last_clean":"2023-06-09T04:39:21.659640+0000","last_became_active":"2023-06-09T04:39:21.656221+0000","last_became_peered":"2023-06-09T04:39:21.656221+0000","last_unstale":"2023-06-09T04:39:21.659640+0000","last_undegraded":"2023-06-09T04:39:21.659640+0000","last_fullsized":"2023-06-09T04:39:21.659640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:47.358550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658609+0000","last_change":"2023-06-09T04:39:21.234617+0000","last_active":"2023-06-09T04:39:22.658609+0000","last_peered":"2023-06-09T04:39:22.658609+0000","last_clean":"2023-06-09T04:39:22.658609+0000","last_became_active":"2023-06-09T04:39:21.234322+0000","last_became_peered":"2023-06-09T04:39:21.234322+0000","last_unstale":"2023-06-09T04:39:22.658609+0000","last_undegraded":"2023-06-09T04:39:22.658609+0000","last_fullsized":"2023-06-09T04:39:22.658609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:15:41.636413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657079+0000","last_change":"2023-06-09T04:39:21.670356+0000","last_active":"2023-06-09T04:39:22.657079+0000","last_peered":"2023-06-09T04:39:22.657079+0000","last_clean":"2023-06-09T04:39:22.657079+0000","last_became_active":"2023-06-09T04:39:21.670042+0000","last_became_peered":"2023-06-09T04:39:21.670042+0000","last_unstale":"2023-06-09T04:39:22.657079+0000","last_undegraded":"2023-06-09T04:39:22.657079+0000","last_fullsized":"2023-06-09T04:39:22.657079+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:35.560398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.675653+0000","last_change":"2023-06-09T04:39:21.241148+0000","last_active":"2023-06-09T04:39:21.675653+0000","last_peered":"2023-06-09T04:39:21.675653+0000","last_clean":"2023-06-09T04:39:21.675653+0000","last_became_active":"2023-06-09T04:39:21.240844+0000","last_became_peered":"2023-06-09T04:39:21.240844+0000","last_unstale":"2023-06-09T04:39:21.675653+0000","last_undegraded":"2023-06-09T04:39:21.675653+0000","last_fullsized":"2023-06-09T04:39:21.675653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:52:12.429689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.672463+0000","last_change":"2023-06-09T04:39:21.667897+0000","last_active":"2023-06-09T04:39:21.672463+0000","last_peered":"2023-06-09T04:39:21.672463+0000","last_clean":"2023-06-09T04:39:21.672463+0000","last_became_active":"2023-06-09T04:39:21.667653+0000","last_became_peered":"2023-06-09T04:39:21.667653+0000","last_unstale":"2023-06-09T04:39:21.672463+0000","last_undegraded":"2023-06-09T04:39:21.672463+0000","last_fullsized":"2023-06-09T04:39:21.672463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:56:20.300372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.660599+0000","last_change":"2023-06-09T04:39:21.241947+0000","last_active":"2023-06-09T04:39:21.660599+0000","last_peered":"2023-06-09T04:39:21.660599+0000","last_clean":"2023-06-09T04:39:21.660599+0000","last_became_active":"2023-06-09T04:39:21.241734+0000","last_became_peered":"2023-06-09T04:39:21.241734+0000","last_unstale":"2023-06-09T04:39:21.660599+0000","last_undegraded":"2023-06-09T04:39:21.660599+0000","last_fullsized":"2023-06-09T04:39:21.660599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:51.520504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663256+0000","last_change":"2023-06-09T04:39:21.655706+0000","last_active":"2023-06-09T04:39:21.663256+0000","last_peered":"2023-06-09T04:39:21.663256+0000","last_clean":"2023-06-09T04:39:21.663256+0000","last_became_active":"2023-06-09T04:39:21.655446+0000","last_became_peered":"2023-06-09T04:39:21.655446+0000","last_unstale":"2023-06-09T04:39:21.663256+0000","last_undegraded":"2023-06-09T04:39:21.663256+0000","last_fullsized":"2023-06-09T04:39:21.663256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:13.954577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651877+0000","last_change":"2023-06-09T04:39:21.237871+0000","last_active":"2023-06-09T04:39:22.651877+0000","last_peered":"2023-06-09T04:39:22.651877+0000","last_clean":"2023-06-09T04:39:22.651877+0000","last_became_active":"2023-06-09T04:39:21.237486+0000","last_became_peered":"2023-06-09T04:39:21.237486+0000","last_unstale":"2023-06-09T04:39:22.651877+0000","last_undegraded":"2023-06-09T04:39:22.651877+0000","last_fullsized":"2023-06-09T04:39:22.651877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:46.353633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160069+0000","last_change":"2023-06-09T04:39:21.668445+0000","last_active":"2023-06-09T04:39:23.160069+0000","last_peered":"2023-06-09T04:39:23.160069+0000","last_clean":"2023-06-09T04:39:23.160069+0000","last_became_active":"2023-06-09T04:39:21.668190+0000","last_became_peered":"2023-06-09T04:39:21.668190+0000","last_unstale":"2023-06-09T04:39:23.160069+0000","last_undegraded":"2023-06-09T04:39:23.160069+0000","last_fullsized":"2023-06-09T04:39:23.160069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:13:16.040590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160127+0000","last_change":"2023-06-09T04:39:21.238718+0000","last_active":"2023-06-09T04:39:23.160127+0000","last_peered":"2023-06-09T04:39:23.160127+0000","last_clean":"2023-06-09T04:39:23.160127+0000","last_became_active":"2023-06-09T04:39:21.238475+0000","last_became_peered":"2023-06-09T04:39:21.238475+0000","last_unstale":"2023-06-09T04:39:23.160127+0000","last_undegraded":"2023-06-09T04:39:23.160127+0000","last_fullsized":"2023-06-09T04:39:23.160127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:36.310513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663558+0000","last_change":"2023-06-09T04:39:21.655957+0000","last_active":"2023-06-09T04:39:21.663558+0000","last_peered":"2023-06-09T04:39:21.663558+0000","last_clean":"2023-06-09T04:39:21.663558+0000","last_became_active":"2023-06-09T04:39:21.655567+0000","last_became_peered":"2023-06-09T04:39:21.655567+0000","last_unstale":"2023-06-09T04:39:21.663558+0000","last_undegraded":"2023-06-09T04:39:21.663558+0000","last_fullsized":"2023-06-09T04:39:21.663558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:30:02.100385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159901+0000","last_change":"2023-06-09T04:39:21.241568+0000","last_active":"2023-06-09T04:39:23.159901+0000","last_peered":"2023-06-09T04:39:23.159901+0000","last_clean":"2023-06-09T04:39:23.159901+0000","last_became_active":"2023-06-09T04:39:21.241105+0000","last_became_peered":"2023-06-09T04:39:21.241105+0000","last_unstale":"2023-06-09T04:39:23.159901+0000","last_undegraded":"2023-06-09T04:39:23.159901+0000","last_fullsized":"2023-06-09T04:39:23.159901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:15:41.636413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.655073+0000","last_change":"2023-06-09T04:39:21.652940+0000","last_active":"2023-06-09T04:39:21.655073+0000","last_peered":"2023-06-09T04:39:21.655073+0000","last_clean":"2023-06-09T04:39:21.655073+0000","last_became_active":"2023-06-09T04:39:21.652677+0000","last_became_peered":"2023-06-09T04:39:21.652677+0000","last_unstale":"2023-06-09T04:39:21.655073+0000","last_undegraded":"2023-06-09T04:39:21.655073+0000","last_fullsized":"2023-06-09T04:39:21.655073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:59:25.345303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658659+0000","last_change":"2023-06-09T04:39:21.234138+0000","last_active":"2023-06-09T04:39:22.658659+0000","last_peered":"2023-06-09T04:39:22.658659+0000","last_clean":"2023-06-09T04:39:22.658659+0000","last_became_active":"2023-06-09T04:39:21.233835+0000","last_became_peered":"2023-06-09T04:39:21.233835+0000","last_unstale":"2023-06-09T04:39:22.658659+0000","last_undegraded":"2023-06-09T04:39:22.658659+0000","last_fullsized":"2023-06-09T04:39:22.658659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:17.038081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658480+0000","last_change":"2023-06-09T04:39:21.667483+0000","last_active":"2023-06-09T04:39:22.658480+0000","last_peered":"2023-06-09T04:39:22.658480+0000","last_clean":"2023-06-09T04:39:22.658480+0000","last_became_active":"2023-06-09T04:39:21.667005+0000","last_became_peered":"2023-06-09T04:39:21.667005+0000","last_unstale":"2023-06-09T04:39:22.658480+0000","last_undegraded":"2023-06-09T04:39:22.658480+0000","last_fullsized":"2023-06-09T04:39:22.658480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:52:13.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657205+0000","last_change":"2023-06-09T04:39:21.237794+0000","last_active":"2023-06-09T04:39:22.657205+0000","last_peered":"2023-06-09T04:39:22.657205+0000","last_clean":"2023-06-09T04:39:22.657205+0000","last_became_active":"2023-06-09T04:39:21.237509+0000","last_became_peered":"2023-06-09T04:39:21.237509+0000","last_unstale":"2023-06-09T04:39:22.657205+0000","last_undegraded":"2023-06-09T04:39:22.657205+0000","last_fullsized":"2023-06-09T04:39:22.657205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:55:03.023772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657096+0000","last_change":"2023-06-09T04:39:21.664739+0000","last_active":"2023-06-09T04:39:22.657096+0000","last_peered":"2023-06-09T04:39:22.657096+0000","last_clean":"2023-06-09T04:39:22.657096+0000","last_became_active":"2023-06-09T04:39:21.664454+0000","last_became_peered":"2023-06-09T04:39:21.664454+0000","last_unstale":"2023-06-09T04:39:22.657096+0000","last_undegraded":"2023-06-09T04:39:22.657096+0000","last_fullsized":"2023-06-09T04:39:22.657096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:11.508900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673533+0000","last_change":"2023-06-09T04:39:21.236585+0000","last_active":"2023-06-09T04:39:21.673533+0000","last_peered":"2023-06-09T04:39:21.673533+0000","last_clean":"2023-06-09T04:39:21.673533+0000","last_became_active":"2023-06-09T04:39:21.236332+0000","last_became_peered":"2023-06-09T04:39:21.236332+0000","last_unstale":"2023-06-09T04:39:21.673533+0000","last_undegraded":"2023-06-09T04:39:21.673533+0000","last_fullsized":"2023-06-09T04:39:21.673533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:10:47.462221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.666805+0000","last_change":"2023-06-09T04:39:21.664366+0000","last_active":"2023-06-09T04:39:21.666805+0000","last_peered":"2023-06-09T04:39:21.666805+0000","last_clean":"2023-06-09T04:39:21.666805+0000","last_became_active":"2023-06-09T04:39:21.664070+0000","last_became_peered":"2023-06-09T04:39:21.664070+0000","last_unstale":"2023-06-09T04:39:21.666805+0000","last_undegraded":"2023-06-09T04:39:21.666805+0000","last_fullsized":"2023-06-09T04:39:21.666805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:01:58.830523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.652056+0000","last_change":"2023-06-09T04:39:21.236879+0000","last_active":"2023-06-09T04:39:22.652056+0000","last_peered":"2023-06-09T04:39:22.652056+0000","last_clean":"2023-06-09T04:39:22.652056+0000","last_became_active":"2023-06-09T04:39:21.236618+0000","last_became_peered":"2023-06-09T04:39:21.236618+0000","last_unstale":"2023-06-09T04:39:22.652056+0000","last_undegraded":"2023-06-09T04:39:22.652056+0000","last_fullsized":"2023-06-09T04:39:22.652056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:41.123556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159799+0000","last_change":"2023-06-09T04:39:21.659682+0000","last_active":"2023-06-09T04:39:23.159799+0000","last_peered":"2023-06-09T04:39:23.159799+0000","last_clean":"2023-06-09T04:39:23.159799+0000","last_became_active":"2023-06-09T04:39:21.659404+0000","last_became_peered":"2023-06-09T04:39:21.659404+0000","last_unstale":"2023-06-09T04:39:23.159799+0000","last_undegraded":"2023-06-09T04:39:23.159799+0000","last_fullsized":"2023-06-09T04:39:23.159799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:32.473658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673227+0000","last_change":"2023-06-09T04:39:21.243888+0000","last_active":"2023-06-09T04:39:21.673227+0000","last_peered":"2023-06-09T04:39:21.673227+0000","last_clean":"2023-06-09T04:39:21.673227+0000","last_became_active":"2023-06-09T04:39:21.243606+0000","last_became_peered":"2023-06-09T04:39:21.243606+0000","last_unstale":"2023-06-09T04:39:21.673227+0000","last_undegraded":"2023-06-09T04:39:21.673227+0000","last_fullsized":"2023-06-09T04:39:21.673227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:44.788382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.659596+0000","last_change":"2023-06-09T04:39:21.655609+0000","last_active":"2023-06-09T04:39:21.659596+0000","last_peered":"2023-06-09T04:39:21.659596+0000","last_clean":"2023-06-09T04:39:21.659596+0000","last_became_active":"2023-06-09T04:39:21.655352+0000","last_became_peered":"2023-06-09T04:39:21.655352+0000","last_unstale":"2023-06-09T04:39:21.659596+0000","last_undegraded":"2023-06-09T04:39:21.659596+0000","last_fullsized":"2023-06-09T04:39:21.659596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:23.881897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.667496+0000","last_change":"2023-06-09T04:39:21.236237+0000","last_active":"2023-06-09T04:39:21.667496+0000","last_peered":"2023-06-09T04:39:21.667496+0000","last_clean":"2023-06-09T04:39:21.667496+0000","last_became_active":"2023-06-09T04:39:21.235945+0000","last_became_peered":"2023-06-09T04:39:21.235945+0000","last_unstale":"2023-06-09T04:39:21.667496+0000","last_undegraded":"2023-06-09T04:39:21.667496+0000","last_fullsized":"2023-06-09T04:39:21.667496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:48.614791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658004+0000","last_change":"2023-06-09T04:39:21.664676+0000","last_active":"2023-06-09T04:39:22.658004+0000","last_peered":"2023-06-09T04:39:22.658004+0000","last_clean":"2023-06-09T04:39:22.658004+0000","last_became_active":"2023-06-09T04:39:21.662401+0000","last_became_peered":"2023-06-09T04:39:21.662401+0000","last_unstale":"2023-06-09T04:39:22.658004+0000","last_undegraded":"2023-06-09T04:39:22.658004+0000","last_fullsized":"2023-06-09T04:39:22.658004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:05:39.515787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160710+0000","last_change":"2023-06-09T04:39:21.240879+0000","last_active":"2023-06-09T04:39:23.160710+0000","last_peered":"2023-06-09T04:39:23.160710+0000","last_clean":"2023-06-09T04:39:23.160710+0000","last_became_active":"2023-06-09T04:39:21.240582+0000","last_became_peered":"2023-06-09T04:39:21.240582+0000","last_unstale":"2023-06-09T04:39:23.160710+0000","last_undegraded":"2023-06-09T04:39:23.160710+0000","last_fullsized":"2023-06-09T04:39:23.160710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:15:31.698513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.663626+0000","last_change":"2023-06-09T04:39:21.656921+0000","last_active":"2023-06-09T04:39:21.663626+0000","last_peered":"2023-06-09T04:39:21.663626+0000","last_clean":"2023-06-09T04:39:21.663626+0000","last_became_active":"2023-06-09T04:39:21.656311+0000","last_became_peered":"2023-06-09T04:39:21.656311+0000","last_unstale":"2023-06-09T04:39:21.663626+0000","last_undegraded":"2023-06-09T04:39:21.663626+0000","last_fullsized":"2023-06-09T04:39:21.663626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:26.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.666716+0000","last_change":"2023-06-09T04:39:21.244010+0000","last_active":"2023-06-09T04:39:21.666716+0000","last_peered":"2023-06-09T04:39:21.666716+0000","last_clean":"2023-06-09T04:39:21.666716+0000","last_became_active":"2023-06-09T04:39:21.243623+0000","last_became_peered":"2023-06-09T04:39:21.243623+0000","last_unstale":"2023-06-09T04:39:21.666716+0000","last_undegraded":"2023-06-09T04:39:21.666716+0000","last_fullsized":"2023-06-09T04:39:21.666716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:01:15.017763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657151+0000","last_change":"2023-06-09T04:39:21.665856+0000","last_active":"2023-06-09T04:39:22.657151+0000","last_peered":"2023-06-09T04:39:22.657151+0000","last_clean":"2023-06-09T04:39:22.657151+0000","last_became_active":"2023-06-09T04:39:21.665603+0000","last_became_peered":"2023-06-09T04:39:21.665603+0000","last_unstale":"2023-06-09T04:39:22.657151+0000","last_undegraded":"2023-06-09T04:39:22.657151+0000","last_fullsized":"2023-06-09T04:39:22.657151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:35:21.046077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.656460+0000","last_change":"2023-06-09T04:39:21.235610+0000","last_active":"2023-06-09T04:39:22.656460+0000","last_peered":"2023-06-09T04:39:22.656460+0000","last_clean":"2023-06-09T04:39:22.656460+0000","last_became_active":"2023-06-09T04:39:21.235265+0000","last_became_peered":"2023-06-09T04:39:21.235265+0000","last_unstale":"2023-06-09T04:39:22.656460+0000","last_undegraded":"2023-06-09T04:39:22.656460+0000","last_fullsized":"2023-06-09T04:39:22.656460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:24:07.540180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.657058+0000","last_change":"2023-06-09T04:38:05.927520+0000","last_active":"2023-06-09T04:39:22.657058+0000","last_peered":"2023-06-09T04:39:22.657058+0000","last_clean":"2023-06-09T04:39:22.657058+0000","last_became_active":"2023-06-09T04:38:05.927274+0000","last_became_peered":"2023-06-09T04:38:05.927274+0000","last_unstale":"2023-06-09T04:39:22.657058+0000","last_undegraded":"2023-06-09T04:39:22.657058+0000","last_fullsized":"2023-06-09T04:39:22.657058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:13.539174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160222+0000","last_change":"2023-06-09T04:39:21.659040+0000","last_active":"2023-06-09T04:39:23.160222+0000","last_peered":"2023-06-09T04:39:23.160222+0000","last_clean":"2023-06-09T04:39:23.160222+0000","last_became_active":"2023-06-09T04:39:21.658409+0000","last_became_peered":"2023-06-09T04:39:21.658409+0000","last_unstale":"2023-06-09T04:39:23.160222+0000","last_undegraded":"2023-06-09T04:39:23.160222+0000","last_fullsized":"2023-06-09T04:39:23.160222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:01:44.403028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.643190+0000","last_change":"2023-06-09T04:39:21.241143+0000","last_active":"2023-06-09T04:39:21.643190+0000","last_peered":"2023-06-09T04:39:21.643190+0000","last_clean":"2023-06-09T04:39:21.643190+0000","last_became_active":"2023-06-09T04:39:21.240824+0000","last_became_peered":"2023-06-09T04:39:21.240824+0000","last_unstale":"2023-06-09T04:39:21.643190+0000","last_undegraded":"2023-06-09T04:39:21.643190+0000","last_fullsized":"2023-06-09T04:39:21.643190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:05:38.510870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.645310+0000","last_change":"2023-06-09T04:38:05.397165+0000","last_active":"2023-06-09T04:39:21.645310+0000","last_peered":"2023-06-09T04:39:21.645310+0000","last_clean":"2023-06-09T04:39:21.645310+0000","last_became_active":"2023-06-09T04:38:05.396837+0000","last_became_peered":"2023-06-09T04:38:05.396837+0000","last_unstale":"2023-06-09T04:39:21.645310+0000","last_undegraded":"2023-06-09T04:39:21.645310+0000","last_fullsized":"2023-06-09T04:39:21.645310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:12.807886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651928+0000","last_change":"2023-06-09T04:39:21.670146+0000","last_active":"2023-06-09T04:39:22.651928+0000","last_peered":"2023-06-09T04:39:22.651928+0000","last_clean":"2023-06-09T04:39:22.651928+0000","last_became_active":"2023-06-09T04:39:21.669851+0000","last_became_peered":"2023-06-09T04:39:21.669851+0000","last_unstale":"2023-06-09T04:39:22.651928+0000","last_undegraded":"2023-06-09T04:39:22.651928+0000","last_fullsized":"2023-06-09T04:39:22.651928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:48.812522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658705+0000","last_change":"2023-06-09T04:39:21.233741+0000","last_active":"2023-06-09T04:39:22.658705+0000","last_peered":"2023-06-09T04:39:22.658705+0000","last_clean":"2023-06-09T04:39:22.658705+0000","last_became_active":"2023-06-09T04:39:21.233440+0000","last_became_peered":"2023-06-09T04:39:21.233440+0000","last_unstale":"2023-06-09T04:39:22.658705+0000","last_undegraded":"2023-06-09T04:39:22.658705+0000","last_fullsized":"2023-06-09T04:39:22.658705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:41:02.104516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651874+0000","last_change":"2023-06-09T04:38:05.399798+0000","last_active":"2023-06-09T04:39:22.651874+0000","last_peered":"2023-06-09T04:39:22.651874+0000","last_clean":"2023-06-09T04:39:22.651874+0000","last_became_active":"2023-06-09T04:38:05.399470+0000","last_became_peered":"2023-06-09T04:38:05.399470+0000","last_unstale":"2023-06-09T04:39:22.651874+0000","last_undegraded":"2023-06-09T04:39:22.651874+0000","last_fullsized":"2023-06-09T04:39:22.651874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:54.801759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160015+0000","last_change":"2023-06-09T04:38:05.399869+0000","last_active":"2023-06-09T04:39:23.160015+0000","last_peered":"2023-06-09T04:39:23.160015+0000","last_clean":"2023-06-09T04:39:23.160015+0000","last_became_active":"2023-06-09T04:38:05.399323+0000","last_became_peered":"2023-06-09T04:38:05.399323+0000","last_unstale":"2023-06-09T04:39:23.160015+0000","last_undegraded":"2023-06-09T04:39:23.160015+0000","last_fullsized":"2023-06-09T04:39:23.160015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:49:06.080865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160428+0000","last_change":"2023-06-09T04:39:21.658926+0000","last_active":"2023-06-09T04:39:23.160428+0000","last_peered":"2023-06-09T04:39:23.160428+0000","last_clean":"2023-06-09T04:39:23.160428+0000","last_became_active":"2023-06-09T04:39:21.658633+0000","last_became_peered":"2023-06-09T04:39:21.658633+0000","last_unstale":"2023-06-09T04:39:23.160428+0000","last_undegraded":"2023-06-09T04:39:23.160428+0000","last_fullsized":"2023-06-09T04:39:23.160428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:59:05.324426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.670094+0000","last_change":"2023-06-09T04:39:21.235590+0000","last_active":"2023-06-09T04:39:21.670094+0000","last_peered":"2023-06-09T04:39:21.670094+0000","last_clean":"2023-06-09T04:39:21.670094+0000","last_became_active":"2023-06-09T04:39:21.235289+0000","last_became_peered":"2023-06-09T04:39:21.235289+0000","last_unstale":"2023-06-09T04:39:21.670094+0000","last_undegraded":"2023-06-09T04:39:21.670094+0000","last_fullsized":"2023-06-09T04:39:21.670094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:46:06.112315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160172+0000","last_change":"2023-06-09T04:38:06.129213+0000","last_active":"2023-06-09T04:39:23.160172+0000","last_peered":"2023-06-09T04:39:23.160172+0000","last_clean":"2023-06-09T04:39:23.160172+0000","last_became_active":"2023-06-09T04:38:06.128923+0000","last_became_peered":"2023-06-09T04:38:06.128923+0000","last_unstale":"2023-06-09T04:39:23.160172+0000","last_undegraded":"2023-06-09T04:39:23.160172+0000","last_fullsized":"2023-06-09T04:39:23.160172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:22:19.233282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658610+0000","last_change":"2023-06-09T04:39:21.666577+0000","last_active":"2023-06-09T04:39:22.658610+0000","last_peered":"2023-06-09T04:39:22.658610+0000","last_clean":"2023-06-09T04:39:22.658610+0000","last_became_active":"2023-06-09T04:39:21.663289+0000","last_became_peered":"2023-06-09T04:39:21.663289+0000","last_unstale":"2023-06-09T04:39:22.658610+0000","last_undegraded":"2023-06-09T04:39:22.658610+0000","last_fullsized":"2023-06-09T04:39:22.658610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:26:28.646322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160012+0000","last_change":"2023-06-09T04:39:21.240890+0000","last_active":"2023-06-09T04:39:23.160012+0000","last_peered":"2023-06-09T04:39:23.160012+0000","last_clean":"2023-06-09T04:39:23.160012+0000","last_became_active":"2023-06-09T04:39:21.240596+0000","last_became_peered":"2023-06-09T04:39:21.240596+0000","last_unstale":"2023-06-09T04:39:23.160012+0000","last_undegraded":"2023-06-09T04:39:23.160012+0000","last_fullsized":"2023-06-09T04:39:23.160012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:41:02.104516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159888+0000","last_change":"2023-06-09T04:38:06.129550+0000","last_active":"2023-06-09T04:39:23.159888+0000","last_peered":"2023-06-09T04:39:23.159888+0000","last_clean":"2023-06-09T04:39:23.159888+0000","last_became_active":"2023-06-09T04:38:06.129198+0000","last_became_peered":"2023-06-09T04:38:06.129198+0000","last_unstale":"2023-06-09T04:39:23.159888+0000","last_undegraded":"2023-06-09T04:39:23.159888+0000","last_fullsized":"2023-06-09T04:39:23.159888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:28:01.200432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.673600+0000","last_change":"2023-06-09T04:39:21.666634+0000","last_active":"2023-06-09T04:39:21.673600+0000","last_peered":"2023-06-09T04:39:21.673600+0000","last_clean":"2023-06-09T04:39:21.673600+0000","last_became_active":"2023-06-09T04:39:21.666338+0000","last_became_peered":"2023-06-09T04:39:21.666338+0000","last_unstale":"2023-06-09T04:39:21.673600+0000","last_undegraded":"2023-06-09T04:39:21.673600+0000","last_fullsized":"2023-06-09T04:39:21.673600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:18.042998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.650563+0000","last_change":"2023-06-09T04:39:21.235445+0000","last_active":"2023-06-09T04:39:21.650563+0000","last_peered":"2023-06-09T04:39:21.650563+0000","last_clean":"2023-06-09T04:39:21.650563+0000","last_became_active":"2023-06-09T04:39:21.234871+0000","last_became_peered":"2023-06-09T04:39:21.234871+0000","last_unstale":"2023-06-09T04:39:21.650563+0000","last_undegraded":"2023-06-09T04:39:21.650563+0000","last_fullsized":"2023-06-09T04:39:21.650563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:14:19.279559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.658302+0000","last_change":"2023-06-09T04:38:06.129847+0000","last_active":"2023-06-09T04:39:22.658302+0000","last_peered":"2023-06-09T04:39:22.658302+0000","last_clean":"2023-06-09T04:39:22.658302+0000","last_became_active":"2023-06-09T04:38:06.129235+0000","last_became_peered":"2023-06-09T04:38:06.129235+0000","last_unstale":"2023-06-09T04:39:22.658302+0000","last_undegraded":"2023-06-09T04:39:22.658302+0000","last_fullsized":"2023-06-09T04:39:22.658302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:08.502737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:22.651625+0000","last_change":"2023-06-09T04:39:21.660217+0000","last_active":"2023-06-09T04:39:22.651625+0000","last_peered":"2023-06-09T04:39:22.651625+0000","last_clean":"2023-06-09T04:39:22.651625+0000","last_became_active":"2023-06-09T04:39:21.660039+0000","last_became_peered":"2023-06-09T04:39:21.660039+0000","last_unstale":"2023-06-09T04:39:22.651625+0000","last_undegraded":"2023-06-09T04:39:22.651625+0000","last_fullsized":"2023-06-09T04:39:22.651625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:23.601535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.159901+0000","last_change":"2023-06-09T04:39:21.240166+0000","last_active":"2023-06-09T04:39:23.159901+0000","last_peered":"2023-06-09T04:39:23.159901+0000","last_clean":"2023-06-09T04:39:23.159901+0000","last_became_active":"2023-06-09T04:39:21.239841+0000","last_became_peered":"2023-06-09T04:39:21.239841+0000","last_unstale":"2023-06-09T04:39:23.159901+0000","last_undegraded":"2023-06-09T04:39:23.159901+0000","last_fullsized":"2023-06-09T04:39:23.159901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:30:01.042387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160415+0000","last_change":"2023-06-09T04:38:06.129263+0000","last_active":"2023-06-09T04:39:23.160415+0000","last_peered":"2023-06-09T04:39:23.160415+0000","last_clean":"2023-06-09T04:39:23.160415+0000","last_became_active":"2023-06-09T04:38:06.128920+0000","last_became_peered":"2023-06-09T04:38:06.128920+0000","last_unstale":"2023-06-09T04:39:23.160415+0000","last_undegraded":"2023-06-09T04:39:23.160415+0000","last_fullsized":"2023-06-09T04:39:23.160415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:25:51.715649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.659099+0000","last_change":"2023-06-09T04:39:21.653587+0000","last_active":"2023-06-09T04:39:21.659099+0000","last_peered":"2023-06-09T04:39:21.659099+0000","last_clean":"2023-06-09T04:39:21.659099+0000","last_became_active":"2023-06-09T04:39:21.653128+0000","last_became_peered":"2023-06-09T04:39:21.653128+0000","last_unstale":"2023-06-09T04:39:21.659099+0000","last_undegraded":"2023-06-09T04:39:21.659099+0000","last_fullsized":"2023-06-09T04:39:21.659099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:21.219268+0000","last_clean_scrub_stamp":"2023-06-09T04:39:21.219268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:18:14.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T04:39:21.648273+0000","last_change":"2023-06-09T04:39:21.239995+0000","last_active":"2023-06-09T04:39:21.648273+0000","last_peered":"2023-06-09T04:39:21.648273+0000","last_clean":"2023-06-09T04:39:21.648273+0000","last_became_active":"2023-06-09T04:39:21.239713+0000","last_became_peered":"2023-06-09T04:39:21.239713+0000","last_unstale":"2023-06-09T04:39:21.648273+0000","last_undegraded":"2023-06-09T04:39:21.648273+0000","last_fullsized":"2023-06-09T04:39:21.648273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:20.214351+0000","last_clean_scrub_stamp":"2023-06-09T04:39:20.214351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:47.807605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:39:23.160570+0000","last_change":"2023-06-09T04:38:05.400002+0000","last_active":"2023-06-09T04:39:23.160570+0000","last_peered":"2023-06-09T04:39:23.160570+0000","last_clean":"2023-06-09T04:39:23.160570+0000","last_became_active":"2023-06-09T04:38:05.399695+0000","last_became_peered":"2023-06-09T04:38:05.399695+0000","last_unstale":"2023-06-09T04:39:23.160570+0000","last_undegraded":"2023-06-09T04:39:23.160570+0000","last_fullsized":"2023-06-09T04:39:23.160570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:04.376702+0000","last_clean_scrub_stamp":"2023-06-09T04:38:04.376702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:17:28.758883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":1003520,"data_stored":755770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Jun 9 04:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.55400000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":164350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.371},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":991232,"data_stored":754226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":13.117000000000001,"5min":13.117000000000001,"15min":13.117000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":5.7969999999999997,"5min":5.7969999999999997,"15min":5.7969999999999997},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":13.930999999999999,"5min":13.930999999999999,"15min":13.930999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":13.148,"5min":13.148,"15min":13.148},"last":0.315}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":5.9169999999999998,"5min":5.9169999999999998,"15min":5.9169999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":13.977,"5min":13.977,"15min":13.977},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":5.8680000000000003,"5min":5.8680000000000003,"15min":5.8680000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":13.082000000000001,"5min":13.082000000000001,"15min":13.082000000000001},"last":0.497}]},{"osd":6,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":13.042999999999999,"5min":13.042999999999999,"15min":13.042999999999999},"last":0.44},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":5.8380000000000001,"5min":5.8380000000000001,"15min":5.8380000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":12.927,"5min":12.927,"15min":12.927},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":380928,"data_stored":155988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.24399999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26400000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":380928,"data_stored":156024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.379}]},{"osd":4,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":158713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":15.971,"5min":15.971,"15min":15.971},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":9.266,"5min":9.266,"15min":9.266},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":9.3819999999999997,"5min":9.3819999999999997,"15min":9.3819999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":15.933,"5min":15.933,"15min":15.933},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":9.1549999999999994,"5min":9.1549999999999994,"15min":9.1549999999999994},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.877}]},{"osd":5,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":9.2289999999999992,"5min":9.2289999999999992,"15min":9.2289999999999992},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":9.1910000000000007,"5min":9.1910000000000007,"15min":9.1910000000000007},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":9.3480000000000008,"5min":9.3480000000000008,"15min":9.3480000000000008},"last":0.69699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":164372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.504},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":163880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":2.9140000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":2.8799999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":2.827}]},{"osd":4,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":2.976},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":1.617}]},{"osd":7,"last update":"Fri Jun 9 04:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":2.9420000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:26.188 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:39:26.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-09T04:39:26.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.352+0000 7f8600d85700 1 Processor -- start 2023-06-09T04:39:26.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.352+0000 7f8600d85700 1 -- start start 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f8600d85700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0cdc40 0x7f85fc1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f8600d85700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc0ca790 con 0x7f85fc1591d0 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f8600d85700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc0caa70 con 0x7f85fc0ca320 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f8600d85700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc159ae0 con 0x7f85fc0cdc40 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f85fa59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85fc1591d0 0x7f85fc0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48996/0 (socket says 172.21.15.26:48996) 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f85fa59c700 1 -- 172.21.15.26:0/3949760947 learned_addr learned my addr 172.21.15.26:0/3949760947 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:26.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.353+0000 7f85fad9d700 1 --2- 172.21.15.26:0/3949760947 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0cdc40 0x7f85fc1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649730743 0 0) 0x7f85fc0ca790 con 0x7f85fc1591d0 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e40035b0 con 0x7f85fc1591d0 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474374546 0 0) 0x7f85fc0caa70 con 0x7f85fc0ca320 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85fc0ca790 con 0x7f85fc0ca320 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85fad9d700 1 -- 172.21.15.26:0/3949760947 >> v1:172.21.15.104:6789/0 conn(0x7f85fc0ca320 legacy=0x7f85fc0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85fad9d700 1 -- 172.21.15.26:0/3949760947 >> v1:172.21.15.26:6789/0 conn(0x7f85fc1591d0 legacy=0x7f85fc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85fad9d700 1 -- 172.21.15.26:0/3949760947 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc0cad50 con 0x7f85fc0cdc40 2023-06-09T04:39:26.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85fad9d700 1 --2- 172.21.15.26:0/3949760947 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0cdc40 0x7f85fc1595a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009dc0 tx=0x7f85f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bcb69071f8d9e05 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400e070 con 0x7f85fc0cdc40 2023-06-09T04:39:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f400bb20 con 0x7f85fc0cdc40 2023-06-09T04:39:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.354+0000 7f85f959a700 1 -- 172.21.15.26:0/3949760947 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400be90 con 0x7f85fc0cdc40 2023-06-09T04:39:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 -- 172.21.15.26:0/3949760947 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0cdc40 msgr2=0x7f85fc1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 --2- 172.21.15.26:0/3949760947 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0cdc40 0x7f85fc1595a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009dc0 tx=0x7f85f400b330 comp rx=0 tx=0).stop 2023-06-09T04:39:26.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 -- 172.21.15.26:0/3949760947 shutdown_connections 2023-06-09T04:39:26.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 --2- 172.21.15.26:0/3949760947 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0cdc40 0x7f85fc1595a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 -- 172.21.15.26:0/3949760947 >> 172.21.15.26:0/3949760947 conn(0x7f85fc0cb9d0 msgr2=0x7f85fc0cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 -- 172.21.15.26:0/3949760947 shutdown_connections 2023-06-09T04:39:26.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.355+0000 7f8600d85700 1 -- 172.21.15.26:0/3949760947 wait complete. 2023-06-09T04:39:26.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.356+0000 7f8600d85700 1 Processor -- start 2023-06-09T04:39:26.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.356+0000 7f8600d85700 1 -- start start 2023-06-09T04:39:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f8600d85700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0ca320 0x7f85fc0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f8600d85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 0x7f85fc1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f8600d85700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85fc1591d0 0x7f85fc152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f8600d85700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc15baf0 con 0x7f85fc0cdc40 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f8600d85700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc15cb80 con 0x7f85fc1591d0 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f8600d85700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc15b530 con 0x7f85fc0ca320 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 0x7f85fc1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 0x7f85fc1526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40146/0 (socket says 172.21.15.26:40146) 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 -- 172.21.15.26:0/1609423952 learned_addr learned my addr 172.21.15.26:0/1609423952 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85fad9d700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85fc1591d0 0x7f85fc152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85fa59c700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0ca320 0x7f85fc0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 -- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0ca320 msgr2=0x7f85fc0c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0ca320 0x7f85fc0c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 -- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85fc1591d0 msgr2=0x7f85fc152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85fc1591d0 0x7f85fc152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.357+0000 7f85f9d9b700 1 -- 172.21.15.26:0/1609423952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4009a70 con 0x7f85fc0cdc40 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.358+0000 7f85f9d9b700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 0x7f85fc1526b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00c520 tx=0x7f85ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.358+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0052d0 con 0x7f85fc0cdc40 2023-06-09T04:39:26.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.358+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec005430 con 0x7f85fc0cdc40 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.358+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0038c0 con 0x7f85fc0cdc40 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.358+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc15b810 con 0x7f85fc0cdc40 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.358+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc15c810 con 0x7f85fc0cdc40 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.359+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc15c390 con 0x7f85fc0cdc40 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.359+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85ec003a20 con 0x7f85fc0cdc40 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.360+0000 7f85eaffd700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85dc06ace0 0x7f85dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.360+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85ec0888d0 con 0x7f85fc0cdc40 2023-06-09T04:39:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.360+0000 7f85fa59c700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85dc06ace0 0x7f85dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.360+0000 7f85fa59c700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85dc06ace0 0x7f85dc06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007fd0 tx=0x7f85f0007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.364+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85fc15c390 con 0x7f85fc0cdc40 2023-06-09T04:39:26.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.643+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f85fc15c390 con 0x7f85fc0cdc40 2023-06-09T04:39:26.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.647+0000 7f85eaffd700 1 -- 172.21.15.26:0/1609423952 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f85fc15c390 con 0x7f85fc0cdc40 2023-06-09T04:39:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85dc06ace0 msgr2=0x7f85dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85dc06ace0 0x7f85dc06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007fd0 tx=0x7f85f0007dc0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 msgr2=0x7f85fc1526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 0x7f85fc1526b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00c520 tx=0x7f85ec00c830 comp rx=0 tx=0).stop 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 shutdown_connections 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85fc1591d0 0x7f85fc152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f85fc0ca320 0x7f85fc0c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f85dc06ace0 0x7f85dc06d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 --2- 172.21.15.26:0/1609423952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc0cdc40 0x7f85fc1526b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 >> 172.21.15.26:0/1609423952 conn(0x7f85fc0cb9d0 msgr2=0x7f85fc0cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 shutdown_connections 2023-06-09T04:39:26.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.649+0000 7f8600d85700 1 -- 172.21.15.26:0/1609423952 wait complete. 2023-06-09T04:39:26.652 INFO:teuthology.orchestra.run.smithi026.stderr:updated caps for client.0 2023-06-09T04:39:26.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.785+0000 7ff3ffdbb700 1 Processor -- start 2023-06-09T04:39:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.785+0000 7ff3ffdbb700 1 -- start start 2023-06-09T04:39:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3ffdbb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3f80cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3ffdbb700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff3f80ae760 0x7ff3f80ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3ffdbb700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f80cd7a0 con 0x7ff3f8159080 2023-06-09T04:39:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3ffdbb700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f8099030 con 0x7ff3f80ae760 2023-06-09T04:39:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3ffdbb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80cca60 con 0x7ff3f80ca520 2023-06-09T04:39:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3fdb57700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff3f8159080 0x7ff3f80c9e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49010/0 (socket says 172.21.15.26:49010) 2023-06-09T04:39:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.786+0000 7ff3fdb57700 1 -- 172.21.15.26:0/4016904215 learned_addr learned my addr 172.21.15.26:0/4016904215 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814971292 0 0) 0x7ff3f80cd7a0 con 0x7ff3f8159080 2023-06-09T04:39:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3f80cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e40057c0 con 0x7ff3f8159080 2023-06-09T04:39:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fe358700 1 --2- 172.21.15.26:0/4016904215 >> v2:172.21.15.104:3300/0 conn(0x7ff3f80ae760 0x7ff3f80ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649371253 0 0) 0x7ff3e40057c0 con 0x7ff3f8159080 2023-06-09T04:39:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 msgr2=0x7ff3f80cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3f80cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 >> v2:172.21.15.104:3300/0 conn(0x7ff3f80ae760 msgr2=0x7ff3f80ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 --2- 172.21.15.26:0/4016904215 >> v2:172.21.15.104:3300/0 conn(0x7ff3f80ae760 0x7ff3f80ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80ccd40 con 0x7ff3f8159080 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1421671353 0 0) 0x7ff3e80017f0 con 0x7ff3f8159080 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 >> v1:172.21.15.26:6789/0 conn(0x7ff3f8159080 legacy=0x7ff3f80c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3e4005c10 0x7ff3e4006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3e4006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3e4007270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8099030 con 0x7ff3e4006640 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80cca60 con 0x7ff3e4005c10 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e400dc20 con 0x7ff3f80ca520 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3e4006b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fdb57700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3e4005c10 0x7ff3e4006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fe358700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3e4007270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 -- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 msgr2=0x7ff3e4007270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3e4007270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 -- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3e4005c10 msgr2=0x7ff3e4006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3e4005c10 0x7ff3e4006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fd356700 1 -- 172.21.15.26:0/4016904215 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e40057c0 con 0x7ff3e4006640 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.787+0000 7ff3fe358700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f80ca520 0x7ff3e4007270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3fd356700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3e4006b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009b60 tx=0x7ff3e4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6880fbec365c093 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400e6c0 con 0x7ff3e4006640 2023-06-09T04:39:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f400e820 con 0x7ff3e4006640 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3fcb55700 1 -- 172.21.15.26:0/4016904215 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400eb90 con 0x7ff3e4006640 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/4016904215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 msgr2=0x7ff3e4006b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/4016904215 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3e4006b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009b60 tx=0x7ff3e4007a90 comp rx=0 tx=0).stop 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3fe358700 1 -- 172.21.15.26:0/4016904215 reap_dead start 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/4016904215 shutdown_connections 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/4016904215 >> 172.21.15.26:0/4016904215 conn(0x7ff3f8098b50 msgr2=0x7ff3f80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/4016904215 shutdown_connections 2023-06-09T04:39:26.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.788+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/4016904215 wait complete. 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 Processor -- start 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 -- start start 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3f8150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f81f5e20 0x7ff3f81e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3f81e18e0 0x7ff3f81e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81e2290 con 0x7ff3e4006640 2023-06-09T04:39:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81e3d60 con 0x7ff3f81e18e0 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.790+0000 7ff3ffdbb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81f6290 con 0x7ff3f81f5e20 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3f8150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3f8150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40164/0 (socket says 172.21.15.26:40164) 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 -- 172.21.15.26:0/3343244315 learned_addr learned my addr 172.21.15.26:0/3343244315 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fd356700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f81f5e20 0x7ff3f81e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fe358700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3f81e18e0 0x7ff3f81e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 -- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f81f5e20 msgr2=0x7ff3f81e3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f81f5e20 0x7ff3f81e3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 -- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3f81e18e0 msgr2=0x7ff3f81e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3f81e18e0 0x7ff3f81e1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 -- 172.21.15.26:0/3343244315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f81e3fe0 con 0x7ff3e4006640 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fd356700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f81f5e20 0x7ff3f81e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3fdb57700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3f8150e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800f8a0 tx=0x7ff3e800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800fea0 con 0x7ff3e4006640 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80072e0 con 0x7ff3e4006640 2023-06-09T04:39:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f81e42c0 con 0x7ff3e4006640 2023-06-09T04:39:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8007670 con 0x7ff3e4006640 2023-06-09T04:39:26.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.791+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f81e4880 con 0x7ff3e4006640 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.792+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f80d0760 con 0x7ff3e4006640 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.793+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3e8005830 con 0x7ff3e4006640 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.793+0000 7ff3ee7fc700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff3dc06ace0 0x7ff3dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.793+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3e8089540 con 0x7ff3e4006640 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.793+0000 7ff3fd356700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff3dc06ace0 0x7ff3dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.794+0000 7ff3fd356700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff3dc06ace0 0x7ff3dc06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40090b0 tx=0x7ff3f4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:26.797+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3e80545f0 con 0x7ff3e4006640 2023-06-09T04:39:27.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.038+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3f8067180 con 0x7ff3e4006640 2023-06-09T04:39:27.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.039+0000 7ff3ee7fc700 1 -- 172.21.15.26:0/3343244315 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4674 (secure 0 0 0) 0x7ff3e8057c10 con 0x7ff3e4006640 2023-06-09T04:39:27.040 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:27.040 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4847,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/1092023330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":1092023330},{"type":"v1","addr":"172.21.15.104:6837","nonce":1092023330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/795405211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":795405211},{"type":"v1","addr":"172.21.15.104:6836","nonce":795405211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/1173816148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1173816148},{"type":"v1","addr":"172.21.15.26:6834","nonce":1173816148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:39:21.639561+0000","modified":"2023-06-09T04:39:24.654718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.26:6835/3278830041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":3278830041},{"type":"v1","addr":"172.21.15.26:6835","nonce":3278830041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:39:27.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff3dc06ace0 msgr2=0x7ff3dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff3dc06ace0 0x7ff3dc06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40090b0 tx=0x7ff3f4008030 comp rx=0 tx=0).stop 2023-06-09T04:39:27.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 msgr2=0x7ff3f8150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3f8150e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800f8a0 tx=0x7ff3e800fc60 comp rx=0 tx=0).stop 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 shutdown_connections 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3f81e18e0 0x7ff3f81e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7ff3dc06ace0 0x7ff3dc06d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e4006640 0x7ff3f8150e90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 --2- 172.21.15.26:0/3343244315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3f81f5e20 0x7ff3f81e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 >> 172.21.15.26:0/3343244315 conn(0x7ff3f8098b50 msgr2=0x7ff3f80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 shutdown_connections 2023-06-09T04:39:27.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.041+0000 7ff3ffdbb700 1 -- 172.21.15.26:0/3343244315 wait complete. 2023-06-09T04:39:27.044 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 15 2023-06-09T04:39:27.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:39:21.639561+0000', 'modified': '2023-06-09T04:39:24.654718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5310}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5310': {'gid': 5310, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.26:6835/3278830041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 3278830041}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3278830041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:39:27.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:39:27.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-09T04:39:27.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.585+0000 7f8936ddb700 1 Processor -- start 2023-06-09T04:39:27.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.585+0000 7f8936ddb700 1 -- start start 2023-06-09T04:39:27.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8936ddb700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8930159d00 0x7f893015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8936ddb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 0x7f89300d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8936ddb700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300cf400 con 0x7f89300d1840 2023-06-09T04:39:27.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8936ddb700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300ceec0 con 0x7f8930159d00 2023-06-09T04:39:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8936ddb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893015d830 con 0x7f89300d0c50 2023-06-09T04:39:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 0x7f89300d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8934b77700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8930159d00 0x7f893015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 0x7f89300d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50834/0 (socket says 172.21.15.26:50834) 2023-06-09T04:39:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 -- 172.21.15.26:0/2145226895 learned_addr learned my addr 172.21.15.26:0/2145226895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 -- 172.21.15.26:0/2145226895 >> v2:172.21.15.104:3300/0 conn(0x7f8930159d00 msgr2=0x7f893015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 --2- 172.21.15.26:0/2145226895 >> v2:172.21.15.104:3300/0 conn(0x7f8930159d00 0x7f893015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 -- 172.21.15.26:0/2145226895 >> v1:172.21.15.104:6789/0 conn(0x7f89300d1840 legacy=0x7f89300cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8935378700 1 -- 172.21.15.26:0/2145226895 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300cf0d0 con 0x7f89300d0c50 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.586+0000 7f8934b77700 1 --2- 172.21.15.26:0/2145226895 >> v2:172.21.15.104:3300/0 conn(0x7f8930159d00 0x7f893015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8935378700 1 --2- 172.21.15.26:0/2145226895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 0x7f89300d1070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8928009e50 tx=0x7f892800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41928d8cf2cd19f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f892f7fe700 1 -- 172.21.15.26:0/2145226895 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800e070 con 0x7f89300d0c50 2023-06-09T04:39:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f892f7fe700 1 -- 172.21.15.26:0/2145226895 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800b910 con 0x7f89300d0c50 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f892f7fe700 1 -- 172.21.15.26:0/2145226895 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800bcc0 con 0x7f89300d0c50 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 -- 172.21.15.26:0/2145226895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 msgr2=0x7f89300d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 --2- 172.21.15.26:0/2145226895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 0x7f89300d1070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8928009e50 tx=0x7f892800b330 comp rx=0 tx=0).stop 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 -- 172.21.15.26:0/2145226895 shutdown_connections 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 --2- 172.21.15.26:0/2145226895 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d0c50 0x7f89300d1070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 --2- 172.21.15.26:0/2145226895 >> v2:172.21.15.104:3300/0 conn(0x7f8930159d00 0x7f893015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 -- 172.21.15.26:0/2145226895 >> 172.21.15.26:0/2145226895 conn(0x7f89300714e0 msgr2=0x7f89300718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 -- 172.21.15.26:0/2145226895 shutdown_connections 2023-06-09T04:39:27.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.587+0000 7f8936ddb700 1 -- 172.21.15.26:0/2145226895 wait complete. 2023-06-09T04:39:27.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 Processor -- start 2023-06-09T04:39:27.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 -- start start 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89300d0c50 0x7f893006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d1840 0x7f89300b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 0x7f89301f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930156180 con 0x7f8930159d00 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930156a20 con 0x7f89300d0c50 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.589+0000 7f8936ddb700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300b88d0 con 0x7f89300d1840 2023-06-09T04:39:27.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 0x7f89301f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 0x7f89301f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40180/0 (socket says 172.21.15.26:40180) 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 -- 172.21.15.26:0/1431759716 learned_addr learned my addr 172.21.15.26:0/1431759716 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8934b77700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89300d0c50 0x7f893006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f892ffff700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d1840 0x7f89300b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 -- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d1840 msgr2=0x7f89300b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d1840 0x7f89300b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 -- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89300d0c50 msgr2=0x7f893006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89300d0c50 0x7f893006b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 -- 172.21.15.26:0/1431759716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924009430 con 0x7f8930159d00 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8935378700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 0x7f89301f1240 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f892800b680 tx=0x7f8928004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f892d7fa700 1 -- 172.21.15.26:0/1431759716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928004830 con 0x7f8930159d00 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f892d7fa700 1 -- 172.21.15.26:0/1431759716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280092e0 con 0x7f8930159d00 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8928009b30 con 0x7f8930159d00 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f892d7fa700 1 -- 172.21.15.26:0/1431759716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892801b650 con 0x7f8930159d00 2023-06-09T04:39:27.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.590+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89301563d0 con 0x7f8930159d00 2023-06-09T04:39:27.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.592+0000 7f892d7fa700 1 -- 172.21.15.26:0/1431759716 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f892801b7b0 con 0x7f8930159d00 2023-06-09T04:39:27.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.593+0000 7f892d7fa700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f891406ace0 0x7f891406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.593+0000 7f892d7fa700 1 -- 172.21.15.26:0/1431759716 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f892808ace0 con 0x7f8930159d00 2023-06-09T04:39:27.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.593+0000 7f8934b77700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f891406ace0 0x7f891406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.593+0000 7f8934b77700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f891406ace0 0x7f891406d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f893014ebf0 tx=0x7f89240091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 Processor -- start 2023-06-09T04:39:27.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 -- start start 2023-06-09T04:39:27.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c2f0 0x55ba47978310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4797cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba479c5c70 0x55ba479c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba478823b0 con 0x55ba4797c6c0 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba47883c60 con 0x55ba479c5c70 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba478d6570 con 0x55ba4797c2f0 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f892ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4797cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f892ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4797cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40186/0 (socket says 172.21.15.26:40186) 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f892ffff700 1 -- 172.21.15.26:0/2403572295 learned_addr learned my addr 172.21.15.26:0/2403572295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8934b77700 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c2f0 0x55ba47978310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.595+0000 7f8935378700 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba479c5c70 0x55ba479c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f892ffff700 1 -- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c2f0 msgr2=0x55ba47978310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f892ffff700 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c2f0 0x55ba47978310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f892ffff700 1 -- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba479c5c70 msgr2=0x55ba479c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f892ffff700 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba479c5c70 0x55ba479c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f892ffff700 1 -- 172.21.15.26:0/2403572295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba476fdd90 con 0x55ba4797c6c0 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f892ffff700 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4797cb30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f891c0016a0 tx=0x7f891c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8695222ab799f560 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f891a7fc700 1 -- 172.21.15.26:0/2403572295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0052e0 con 0x55ba4797c6c0 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f891a7fc700 1 -- 172.21.15.26:0/2403572295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c005440 con 0x55ba4797c6c0 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.596+0000 7f891a7fc700 1 -- 172.21.15.26:0/2403572295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0038a0 con 0x55ba4797c6c0 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 -- 172.21.15.26:0/2403572295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 msgr2=0x55ba4797cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4797cb30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f891c0016a0 tx=0x7f891c007ec0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 -- 172.21.15.26:0/2403572295 shutdown_connections 2023-06-09T04:39:27.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba479c5c70 0x55ba479c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c2f0 0x55ba47978310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2403572295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4797cb30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 -- 172.21.15.26:0/2403572295 >> 172.21.15.26:0/2403572295 conn(0x55ba4797ace0 msgr2=0x55ba479c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 -- 172.21.15.26:0/2403572295 shutdown_connections 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 -- 172.21.15.26:0/2403572295 wait complete. 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.597+0000 7f8942f60b80 1 -- start start 2023-06-09T04:39:27.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 Processor -- start 2023-06-09T04:39:27.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba479a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba4797e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba478cfa00 con 0x55ba4797c6c0 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4786fa70 con 0x55ba4797c2f0 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba4786f770 con 0x55ba479c5c70 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.598+0000 7f8942f60b80 10 client.0 _ll_register_callbacks cb 0x55ba4786d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba479a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba479a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40192/0 (socket says 172.21.15.26:40192) 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 -- 172.21.15.26:0/3874180635 learned_addr learned my addr 172.21.15.26:0/3874180635 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f8934b77700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f8935378700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba4797e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 -- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 msgr2=0x55ba4797e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba4797e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 -- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 msgr2=0x55ba4799f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 -- 172.21.15.26:0/3874180635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89300cf400 con 0x55ba4797c6c0 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f8935378700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba4797e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f892ffff700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba479a7f60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f891c007f20 tx=0x7f891c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ae8beb140e5ff5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f890f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f890f7fe700 1 -- 172.21.15.26:0/3874180635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0052e0 con 0x55ba4797c6c0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f890f7fe700 1 -- 172.21.15.26:0/3874180635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f891c007b80 con 0x55ba4797c6c0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba47970850 con 0x55ba4797c6c0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f890f7fe700 1 -- 172.21.15.26:0/3874180635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f891c01c810 con 0x55ba4797c6c0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f8942f60b80 10 client.5481 fetch_fsmap learned FSMap version 15 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.599+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ba476e6c10 con 0x55ba4797c6c0 2023-06-09T04:39:27.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f890f7fe700 1 -- 172.21.15.26:0/3874180635 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ba47970850 con 0x55ba4797c6c0 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f890f7fe700 1 -- 172.21.15.26:0/3874180635 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f891c012070 con 0x55ba4797c6c0 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8942f60b80 10 client.5481 fetch_fsmap finished waiting for FSMap version 15 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8942f60b80 10 client.5481 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8942f60b80 20 client.5481 populate_metadata read hostname 'smithi026' 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8942f60b80 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba479d6670 0x55ba479d6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8942f60b80 4 client.5481 mds_command: new command op to 5310 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:39:27.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 --> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba478c89e0 con 0x55ba479d6670 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.600+0000 7f8934b77700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba479d6670 0x55ba479d6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f890f7fe700 10 client.5481 ms_handle_connect on v2:172.21.15.26:6833/3278830041 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f8934b77700 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba479d6670 0x55ba479d6a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9781e3fb4369c00 server_cookie=cc87c9891b64bee3 in_seq=0 out_seq=0 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f890f7fe700 1 -- 172.21.15.26:0/3874180635 <== mds.0 v2:172.21.15.26:6833/3278830041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ba478c89e0 con 0x55ba479d6670 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f890f7fe700 10 client.5481 handle_command_reply: tid=0 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f8942f60b80 1 client.5481 shutdown 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 msgr2=0x55ba479a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f8942f60b80 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba479a7f60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f891c007f20 tx=0x7f891c000ed0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.601+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 shutdown_connections 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba4797e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba479d6670 0x55ba479d6a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 --2- 172.21.15.26:0/3874180635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba479a7f60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f890f7fe700 0 client.5481 ms_handle_reset on v2:172.21.15.26:6833/3278830041 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 >> 172.21.15.26:0/3874180635 conn(0x55ba4797ace0 msgr2=0x55ba479c5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 shutdown_connections 2023-06-09T04:39:27.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 1 -- 172.21.15.26:0/3874180635 wait complete. 2023-06-09T04:39:27.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.602+0000 7f8942f60b80 20 client.5481 trim_cache size 0 max 16384 2023-06-09T04:39:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.619+0000 7f8942f60b80 1 Processor -- start 2023-06-09T04:39:27.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.619+0000 7f8942f60b80 1 -- start start 2023-06-09T04:39:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba47978040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c6c0 0x55ba4797ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 0x55ba47972440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8942f60b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba477538d0 con 0x55ba479c5c70 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba479c2ef0 con 0x55ba4797c2f0 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba479ba080 con 0x55ba4797c6c0 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 0x55ba47972440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 0x55ba47972440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40202/0 (socket says 172.21.15.26:40202) 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 -- 172.21.15.26:0/29215580 learned_addr learned my addr 172.21.15.26:0/29215580 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8934b77700 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba47978040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f892ffff700 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c6c0 0x55ba4797ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 -- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c6c0 msgr2=0x55ba4797ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c6c0 0x55ba4797ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 -- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 msgr2=0x55ba47978040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba47978040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.620+0000 7f8935378700 1 -- 172.21.15.26:0/29215580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba47724200 con 0x55ba479c5c70 2023-06-09T04:39:27.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8935378700 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 0x55ba47972440 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8928003fd0 tx=0x7f89280598e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2ee1d723220123 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f891affd700 1 -- 172.21.15.26:0/29215580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892805da00 con 0x55ba479c5c70 2023-06-09T04:39:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f891affd700 1 -- 172.21.15.26:0/29215580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928061d90 con 0x55ba479c5c70 2023-06-09T04:39:27.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f891affd700 1 -- 172.21.15.26:0/29215580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928071120 con 0x55ba479c5c70 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 -- 172.21.15.26:0/29215580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 msgr2=0x55ba47972440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 0x55ba47972440 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8928003fd0 tx=0x7f89280598e0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 -- 172.21.15.26:0/29215580 shutdown_connections 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba479c5c70 0x55ba47972440 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba47978040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 --2- 172.21.15.26:0/29215580 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba4797c6c0 0x55ba4797ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 -- 172.21.15.26:0/29215580 >> 172.21.15.26:0/29215580 conn(0x55ba4797ace0 msgr2=0x55ba47971ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 -- 172.21.15.26:0/29215580 shutdown_connections 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.621+0000 7f8942f60b80 1 -- 172.21.15.26:0/29215580 wait complete. 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.622+0000 7f8942f60b80 1 -- start start 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.622+0000 7f8942f60b80 1 Processor -- start 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4799e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba47a29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba479b9bf0 con 0x55ba4797c6c0 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba47a2a9c0 con 0x55ba4797c2f0 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba479a03e0 con 0x55ba479c5c70 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8942f60b80 10 client.0 _ll_register_callbacks cb 0x55ba4786d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4799e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4799e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40206/0 (socket says 172.21.15.26:40206) 2023-06-09T04:39:27.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 -- 172.21.15.26:0/2492241240 learned_addr learned my addr 172.21.15.26:0/2492241240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8934b77700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f8935378700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba47a29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 -- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 msgr2=0x55ba47a29900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba47a29900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 -- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 msgr2=0x55ba4799fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.623+0000 7f892ffff700 1 -- 172.21.15.26:0/2492241240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89301563d0 con 0x55ba4797c6c0 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f892ffff700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4799e240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f891c007f20 tx=0x7f891c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd4319794ba3fe9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f890f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f890f7fe700 1 -- 172.21.15.26:0/2492241240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c003d60 con 0x55ba4797c6c0 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f890f7fe700 1 -- 172.21.15.26:0/2492241240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f891c007b80 con 0x55ba4797c6c0 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f891c005440 con 0x55ba4797c6c0 2023-06-09T04:39:27.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f890f7fe700 1 -- 172.21.15.26:0/2492241240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f891c006860 con 0x55ba4797c6c0 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 10 client.5487 fetch_fsmap learned FSMap version 15 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55ba476fc260 con 0x55ba4797c6c0 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f890f7fe700 1 -- 172.21.15.26:0/2492241240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c005440 con 0x55ba4797c6c0 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f890f7fe700 1 -- 172.21.15.26:0/2492241240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f891c012070 con 0x55ba4797c6c0 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 10 client.5487 fetch_fsmap finished waiting for FSMap version 15 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 10 client.5487 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-09T04:39:27.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 20 client.5487 populate_metadata read hostname 'smithi026' 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba47a2dd20 0x55ba47a2e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 4 client.5487 mds_command: new command op to 5310 tid=0[{"prefix": "status"}] 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 --> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ba4788b000 con 0x55ba47a2dd20 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.624+0000 7f8934b77700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba47a2dd20 0x55ba47a2e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f890f7fe700 10 client.5487 ms_handle_connect on v2:172.21.15.26:6833/3278830041 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8934b77700 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba47a2dd20 0x55ba47a2e0f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f1310e39d66714 server_cookie=99296dcc792bcb5 in_seq=0 out_seq=0 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f890f7fe700 1 -- 172.21.15.26:0/2492241240 <== mds.0 v2:172.21.15.26:6833/3278830041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ba4788b000 con 0x55ba47a2dd20 2023-06-09T04:39:27.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f890f7fe700 10 client.5487 handle_command_reply: tid=0 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 client.5487 shutdown 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 msgr2=0x55ba4799e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4799e240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f891c007f20 tx=0x7f891c009040 comp rx=0 tx=0).stop 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 shutdown_connections 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55ba479c5c70 0x55ba47a29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:6833/3278830041,v1:172.21.15.26:6835/3278830041] conn(0x55ba47a2dd20 0x55ba47a2e0f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ba4797c2f0 0x55ba4799fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 --2- 172.21.15.26:0/2492241240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ba4797c6c0 0x55ba4799e240 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 >> 172.21.15.26:0/2492241240 conn(0x55ba4797ace0 msgr2=0x55ba47978040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f890f7fe700 0 client.5487 ms_handle_reset on v2:172.21.15.26:6833/3278830041 2023-06-09T04:39:27.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 shutdown_connections 2023-06-09T04:39:27.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 1 -- 172.21.15.26:0/2492241240 wait complete. 2023-06-09T04:39:27.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.625+0000 7f8942f60b80 20 client.5487 trim_cache size 0 max 16384 2023-06-09T04:39:27.637 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "d8ea66dc-572e-4c93-a618-c44f62bf95ff", 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5310, 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-06-09T04:39:27.638 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 5.9849708599999998, 2023-06-09T04:39:27.639 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 15, 2023-06-09T04:39:27.639 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 35, 2023-06-09T04:39:27.639 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 35, 2023-06-09T04:39:27.639 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 14.261295195000001 2023-06-09T04:39:27.639 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-06-09T04:39:27.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f891406ace0 msgr2=0x7f891406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f891406ace0 0x7f891406d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f893014ebf0 tx=0x7f89240091c0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 msgr2=0x7f89301f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 0x7f89301f1240 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f892800b680 tx=0x7f8928004ad0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 shutdown_connections 2023-06-09T04:39:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f891406ace0 0x7f891406d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8930159d00 0x7f89301f1240 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89300d0c50 0x7f893006b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 --2- 172.21.15.26:0/1431759716 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f89300d1840 0x7f89300b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 >> 172.21.15.26:0/1431759716 conn(0x7f89300714e0 msgr2=0x7f8930157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 shutdown_connections 2023-06-09T04:39:27.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.626+0000 7f8936ddb700 1 -- 172.21.15.26:0/1431759716 wait complete. 2023-06-09T04:39:27.643 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:39:27.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.766+0000 7f285fc34700 1 Processor -- start 2023-06-09T04:39:27.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.766+0000 7f285fc34700 1 -- start start 2023-06-09T04:39:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285fc34700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2858159080 0x7f28580c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285fc34700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28580cec40 0x7f28580ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285fc34700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580cd7a0 con 0x7f28580ae760 2023-06-09T04:39:27.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285fc34700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2858099030 con 0x7f28580cec40 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285fc34700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580cca60 con 0x7f2858159080 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285e1d1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f28580cec40 0x7f28580ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285d1cf700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f28580ae760 0x7f285815cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49070/0 (socket says 172.21.15.26:49070) 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.767+0000 7f285d1cf700 1 -- 172.21.15.26:0/2251931483 learned_addr learned my addr 172.21.15.26:0/2251931483 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285d9d0700 1 --2- 172.21.15.26:0/2251931483 >> v2:172.21.15.104:3300/0 conn(0x7f2858159080 0x7f28580c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285e1d1700 1 -- 172.21.15.26:0/2251931483 >> v2:172.21.15.104:3300/0 conn(0x7f2858159080 msgr2=0x7f28580c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285e1d1700 1 --2- 172.21.15.26:0/2251931483 >> v2:172.21.15.104:3300/0 conn(0x7f2858159080 0x7f28580c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285e1d1700 1 -- 172.21.15.26:0/2251931483 >> v1:172.21.15.26:6789/0 conn(0x7f28580ae760 legacy=0x7f285815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285c9ce700 1 -- 172.21.15.26:0/2251931483 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505640567 0 0) 0x7f28580cd7a0 con 0x7f28580ae760 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285e1d1700 1 -- 172.21.15.26:0/2251931483 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580ccd40 con 0x7f28580cec40 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285e1d1700 1 --2- 172.21.15.26:0/2251931483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f28580ca350 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2858070d70 tx=0x7f285000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8728d9defd3128 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285c9ce700 1 -- 172.21.15.26:0/2251931483 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850010070 con 0x7f28580cec40 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285c9ce700 1 -- 172.21.15.26:0/2251931483 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285000b2e0 con 0x7f28580cec40 2023-06-09T04:39:27.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.768+0000 7f285c9ce700 1 -- 172.21.15.26:0/2251931483 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000dcc0 con 0x7f28580cec40 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 -- 172.21.15.26:0/2251931483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 msgr2=0x7f28580ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 --2- 172.21.15.26:0/2251931483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f28580ca350 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2858070d70 tx=0x7f285000d330 comp rx=0 tx=0).stop 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 -- 172.21.15.26:0/2251931483 shutdown_connections 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 --2- 172.21.15.26:0/2251931483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f28580ca350 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 --2- 172.21.15.26:0/2251931483 >> v2:172.21.15.104:3300/0 conn(0x7f2858159080 0x7f28580c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 -- 172.21.15.26:0/2251931483 >> 172.21.15.26:0/2251931483 conn(0x7f2858098b50 msgr2=0x7f28580cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 -- 172.21.15.26:0/2251931483 shutdown_connections 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.769+0000 7f285fc34700 1 -- 172.21.15.26:0/2251931483 wait complete. 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.770+0000 7f285fc34700 1 Processor -- start 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.770+0000 7f285fc34700 1 -- start start 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28580ae760 0x7f28580c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f2858152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2858159080 0x7f28580c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580b2820 con 0x7f28580cec40 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580c9240 con 0x7f28580ae760 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580c78d0 con 0x7f2858159080 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f2858152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f2858152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40218/0 (socket says 172.21.15.26:40218) 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 -- 172.21.15.26:0/2531796698 learned_addr learned my addr 172.21.15.26:0/2531796698 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d9d0700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28580ae760 0x7f28580c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285e1d1700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2858159080 0x7f28580c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 -- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2858159080 msgr2=0x7f28580c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2858159080 0x7f28580c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 -- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28580ae760 msgr2=0x7f28580c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28580ae760 0x7f28580c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 -- 172.21.15.26:0/2531796698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285000bc80 con 0x7f28580cec40 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285d1cf700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f2858152c00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f28540011e0 tx=0x7f285400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854004c80 con 0x7f28580cec40 2023-06-09T04:39:27.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854004e00 con 0x7f28580cec40 2023-06-09T04:39:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28580c6dd0 con 0x7f28580cec40 2023-06-09T04:39:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854007310 con 0x7f28580cec40 2023-06-09T04:39:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.771+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28580c7310 con 0x7f28580cec40 2023-06-09T04:39:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.772+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28580d0760 con 0x7f28580cec40 2023-06-09T04:39:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.773+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2854007470 con 0x7f28580cec40 2023-06-09T04:39:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.773+0000 7f284e7fc700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f283c06ace0 0x7f283c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.773+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2854089190 con 0x7f28580cec40 2023-06-09T04:39:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.773+0000 7f285d9d0700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f283c06ace0 0x7f283c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.774+0000 7f285d9d0700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f283c06ace0 0x7f283c06d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2848006fd0 tx=0x7f2848008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:27.778+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28540542d0 con 0x7f28580cec40 2023-06-09T04:39:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.023+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28580b2960 con 0x7f28580cec40 2023-06-09T04:39:28.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.024+0000 7f284e7fc700 1 -- 172.21.15.26:0/2531796698 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28580b2960 con 0x7f28580cec40 2023-06-09T04:39:28.025 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:39:28.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f283c06ace0 msgr2=0x7f283c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f283c06ace0 0x7f283c06d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2848006fd0 tx=0x7f2848008040 comp rx=0 tx=0).stop 2023-06-09T04:39:28.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 msgr2=0x7f2858152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f2858152c00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f28540011e0 tx=0x7f285400cae0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 shutdown_connections 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2858159080 0x7f28580c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28580ae760 0x7f28580c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f283c06ace0 0x7f283c06d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 --2- 172.21.15.26:0/2531796698 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28580cec40 0x7f2858152c00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 >> 172.21.15.26:0/2531796698 conn(0x7f2858098b50 msgr2=0x7f28580cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:28.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 shutdown_connections 2023-06-09T04:39:28.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:28.026+0000 7f285fc34700 1 -- 172.21.15.26:0/2531796698 wait complete. 2023-06-09T04:39:28.039 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:39:28.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:39:28.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-06-09T04:39:28.040 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:39:28.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:28.040 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:39:28.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:39:28.041 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:39:28.041 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:39:28.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.042 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-06-09T04:39:28.059 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:39:28.059 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:39:28.059 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:39:28.059 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.059 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:39:28.060 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42059sec preferred_lft 42059sec 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:39:28.061 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 4a:be:6e:46:45:82 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::cc7d:7ff:fefe:5d82/64 scope link 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether b2:98:7b:f0:ed:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::b098:7bff:fef0:edab/64 scope link 2023-06-09T04:39:28.062 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.063 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:39:28.063 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 4a:be:6e:46:45:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:39:28.063 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::48be:6eff:fe46:4582/64 scope link 2023-06-09T04:39:28.063 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:28.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.064 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:39:28.124 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-06-09T04:39:28.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.126 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-06-09T04:39:28.184 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-06-09T04:39:28.184 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:39:28.184 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-09T04:39:28.185 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-09T04:39:28.185 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:39:28.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.185 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-06-09T04:39:28.186 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-06-09T04:39:28.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:39:28.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:39:28.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:39:28.187 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-06-09T04:39:28.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.290 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-06-09T04:39:28.306 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T04:39:28.307 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:39:28.307 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:39:28.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-06-09T04:39:28.373 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-09T04:39:28.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:39:28.374 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:28.430 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:39:28.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:39:28.431 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:28.487 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-06-09T04:39:28.554 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:39:28.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:39:28.621 INFO:teuthology.orchestra.run.smithi026.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:39:28.622 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:39:28.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.623 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-06-09T04:39:28.679 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:39:28.680 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-09T04:39:28.722 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2023-06-09T04:39:28.749 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:39:28.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:39:28.811 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2023-06-09T04:39:28.810+0000 7f43cb2c55c0 -1 init, newargv = 0x56344655a070 newargc=15 2023-06-09T04:39:28.811 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[146319]: starting ceph client 2023-06-09T04:39:28.817 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[146319]: starting fuse 2023-06-09T04:39:28.818 INFO:teuthology.orchestra.run.smithi026.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:39:28.819 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:39:28.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:28.820 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2023-06-09T04:39:28.877 INFO:teuthology.orchestra.run.smithi026.stdout:47 2023-06-09T04:39:28.877 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-06-09T04:39:28.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:39:28.878 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2023-06-09T04:39:28.878 DEBUG:teuthology.orchestra.run.smithi026:> import re 2023-06-09T04:39:28.879 DEBUG:teuthology.orchestra.run.smithi026:> import os 2023-06-09T04:39:28.879 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2023-06-09T04:39:28.879 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:39:28.879 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2023-06-09T04:39:28.880 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-09T04:39:28.880 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2023-06-09T04:39:28.880 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-09T04:39:28.881 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:39:28.881 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2023-06-09T04:39:28.881 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2023-06-09T04:39:28.882 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2023-06-09T04:39:28.882 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2023-06-09T04:39:28.882 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:39:28.883 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2023-06-09T04:39:28.883 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:39:28.883 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:39:28.883 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:39:28.884 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2023-06-09T04:39:28.884 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2023-06-09T04:39:28.884 DEBUG:teuthology.orchestra.run.smithi026:> return f 2023-06-09T04:39:28.885 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:39:28.885 DEBUG:teuthology.orchestra.run.smithi026:> 2023-06-09T04:39:28.885 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2023-06-09T04:39:28.886 DEBUG:teuthology.orchestra.run.smithi026:> ' 2023-06-09T04:39:29.001 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.146319.asok 2023-06-09T04:39:29.183 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.146319.asok 2023-06-09T04:39:29.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:29.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.146319.asok status 2023-06-09T04:39:29.344 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-06-09T04:39:29.344 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2023-06-09T04:39:29.344 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:39:29.344 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:39:29.344 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2023-06-09T04:39:29.344 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "146319", 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 5502, 2023-06-09T04:39:29.345 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 5502 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:39:29.346 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1595851823 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1595851823 2023-06-09T04:39:29.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.5502 192.168.0.1:0/1595851823", 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/1595851823", 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 15, 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 35, 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2023-06-09T04:39:29.349 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-06-09T04:39:29.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:29.354 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2023-06-09T04:39:29.354 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:29.371 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2023-06-09T04:39:29.371 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:29.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:29.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:29.439 DEBUG:teuthology.orchestra.run.smithi026:> mktemp -d --suffix=xfstests-dev 2023-06-09T04:39:29.495 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.dLknDlhvfJxfstests-dev 2023-06-09T04:39:29.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:29.496 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.dLknDlhvfJxfstests-dev) 2023-06-09T04:39:29.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:29.563 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.dLknDlhvfJxfstests-dev) 2023-06-09T04:39:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:Cloning into '/tmp/tmp.dLknDlhvfJxfstests-dev'... 2023-06-09T04:39:30.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:30.260 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-09T04:39:30.322 DEBUG:teuthology.orchestra.run.smithi026:> mktemp -d --suffix=test 2023-06-09T04:39:30.379 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.QgJpq9IdBDtest 2023-06-09T04:39:30.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:30.380 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-09T04:39:30.439 DEBUG:teuthology.orchestra.run.smithi026:> mktemp -d --suffix=scratch 2023-06-09T04:39:30.495 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.R6es7WFHvvscratch 2023-06-09T04:39:30.495 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-06-09T04:39:30.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-09T04:39:30.911 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-06-09T04:39:31.755 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:04:15 ago on Fri 09 Jun 2023 04:35:16 AM UTC. 2023-06-09T04:39:33.182 INFO:teuthology.orchestra.run.smithi026.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:39:33.183 INFO:teuthology.orchestra.run.smithi026.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:39:33.184 INFO:teuthology.orchestra.run.smithi026.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-09T04:39:33.186 INFO:teuthology.orchestra.run.smithi026.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-09T04:39:33.187 INFO:teuthology.orchestra.run.smithi026.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-09T04:39:33.189 INFO:teuthology.orchestra.run.smithi026.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-06-09T04:39:33.191 INFO:teuthology.orchestra.run.smithi026.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-09T04:39:33.193 INFO:teuthology.orchestra.run.smithi026.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-06-09T04:39:33.195 INFO:teuthology.orchestra.run.smithi026.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-09T04:39:33.196 INFO:teuthology.orchestra.run.smithi026.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-06-09T04:39:33.197 INFO:teuthology.orchestra.run.smithi026.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-09T04:39:33.198 INFO:teuthology.orchestra.run.smithi026.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-09T04:39:33.199 INFO:teuthology.orchestra.run.smithi026.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-09T04:39:33.201 INFO:teuthology.orchestra.run.smithi026.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-09T04:39:33.202 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-09T04:39:33.203 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:39:33.204 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:39:33.205 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:39:33.207 INFO:teuthology.orchestra.run.smithi026.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-09T04:39:33.208 INFO:teuthology.orchestra.run.smithi026.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-06-09T04:39:33.209 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:39:33.211 INFO:teuthology.orchestra.run.smithi026.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-06-09T04:39:33.216 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:39:33.340 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-06-09T04:39:33.342 INFO:teuthology.orchestra.run.smithi026.stdout:==================================================================================================================== 2023-06-09T04:39:33.343 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-06-09T04:39:33.343 INFO:teuthology.orchestra.run.smithi026.stdout:==================================================================================================================== 2023-06-09T04:39:33.343 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-06-09T04:39:33.343 INFO:teuthology.orchestra.run.smithi026.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-06-09T04:39:33.343 INFO:teuthology.orchestra.run.smithi026.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-09T04:39:33.343 INFO:teuthology.orchestra.run.smithi026.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-06-09T04:39:33.344 INFO:teuthology.orchestra.run.smithi026.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-06-09T04:39:33.345 INFO:teuthology.orchestra.run.smithi026.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling module streams: 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout: python27 2.7 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout:==================================================================================================================== 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout:Install 14 Packages 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2023-06-09T04:39:33.346 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:33.347 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 12 M 2023-06-09T04:39:33.347 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-06-09T04:39:33.568 INFO:teuthology.orchestra.run.smithi026.stdout:(1/16): dump-0.4-0.36.b46.el8.x86_64.rpm 1.2 MB/s | 164 kB 00:00 2023-06-09T04:39:33.593 INFO:teuthology.orchestra.run.smithi026.stdout:(2/16): rmt-1.5.3-13.el8.x86_64.rpm 315 kB/s | 51 kB 00:00 2023-06-09T04:39:33.619 INFO:teuthology.orchestra.run.smithi026.stdout:(3/16): daxctl-libs-71.1-3.el8.x86_64.rpm 913 kB/s | 42 kB 00:00 2023-06-09T04:39:33.644 INFO:teuthology.orchestra.run.smithi026.stdout:(4/16): ndctl-libs-71.1-3.el8.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-06-09T04:39:33.669 INFO:teuthology.orchestra.run.smithi026.stdout:(5/16): python2-setuptools-wheel-39.0.1-13.modu 5.6 MB/s | 287 kB 00:00 2023-06-09T04:39:33.703 INFO:teuthology.orchestra.run.smithi026.stdout:(6/16): python2-setuptools-39.0.1-13.module+el8 11 MB/s | 642 kB 00:00 2023-06-09T04:39:33.720 INFO:teuthology.orchestra.run.smithi026.stdout:(7/16): python2-wheel-wheel-0.31.1-3.module+el8 881 kB/s | 45 kB 00:00 2023-06-09T04:39:33.754 INFO:teuthology.orchestra.run.smithi026.stdout:(8/16): fio-3.19-3.el8.x86_64.rpm 11 MB/s | 538 kB 00:00 2023-06-09T04:39:33.779 INFO:teuthology.orchestra.run.smithi026.stdout:(9/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2023-06-09T04:39:33.804 INFO:teuthology.orchestra.run.smithi026.stdout:(10/16): python2-2.7.18-10.module+el8.6.0+14191 2.1 MB/s | 110 kB 00:00 2023-06-09T04:39:33.913 INFO:teuthology.orchestra.run.smithi026.stdout:(11/16): python2-pip-9.0.3-19.module+el8.6.0+13 15 MB/s | 1.6 MB 00:00 2023-06-09T04:39:33.963 INFO:teuthology.orchestra.run.smithi026.stdout:(12/16): python2-pip-wheel-9.0.3-19.module+el8. 17 MB/s | 892 kB 00:00 2023-06-09T04:39:34.047 INFO:teuthology.orchestra.run.smithi026.stdout:(13/16): python2-libs-2.7.18-10.module+el8.6.0+ 22 MB/s | 6.0 MB 00:00 2023-06-09T04:39:34.080 INFO:teuthology.orchestra.run.smithi026.stdout:(14/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 5.6 MB/s | 668 kB 00:00 2023-06-09T04:39:34.114 INFO:teuthology.orchestra.run.smithi026.stdout:(15/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2023-06-09T04:39:34.189 INFO:teuthology.orchestra.run.smithi026.stdout:(16/16): indent-2.2.13-2.el8.x86_64.rpm 246 kB/s | 187 kB 00:00 2023-06-09T04:39:34.190 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-06-09T04:39:34.191 INFO:teuthology.orchestra.run.smithi026.stdout:Total 14 MB/s | 12 MB 00:00 2023-06-09T04:39:34.402 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-06-09T04:39:34.445 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-06-09T04:39:34.445 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-06-09T04:39:34.642 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-06-09T04:39:34.647 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-06-09T04:39:35.471 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-06-09T04:39:35.687 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-06-09T04:39:35.857 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-09T04:39:35.927 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-09T04:39:36.140 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-09T04:39:36.216 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-09T04:39:36.407 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-09T04:39:36.553 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-09T04:39:36.695 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 5/18 2023-06-09T04:39:37.006 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-06-09T04:39:37.678 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-06-09T04:39:37.922 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 8/18 2023-06-09T04:39:38.123 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-06-09T04:39:39.330 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-06-09T04:39:39.646 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 10/18 2023-06-09T04:39:39.867 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/18 2023-06-09T04:39:40.167 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-09T04:39:40.448 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-06-09T04:39:40.660 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-06-09T04:39:40.831 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-06-09T04:39:41.024 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-06-09T04:39:41.157 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-06-09T04:39:41.341 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-09T04:39:41.643 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-06-09T04:39:41.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 8/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fio-3.19-3.el8.x86_64 9/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 10/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 11/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 12/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 13/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 14/18 2023-06-09T04:39:41.645 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-06-09T04:39:41.646 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-06-09T04:39:41.646 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-06-09T04:39:43.006 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-09T04:39:43.006 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:04:27 ago on Fri 09 Jun 2023 04:35:16 AM UTC. 2023-06-09T04:39:45.685 INFO:teuthology.orchestra.run.smithi026.stdout:Installed products updated. 2023-06-09T04:39:45.897 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:45.897 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-06-09T04:39:45.897 INFO:teuthology.orchestra.run.smithi026.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout: fio-3.19-3.el8.x86_64 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout: indent-2.2.13-2.el8.x86_64 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-09T04:39:45.898 INFO:teuthology.orchestra.run.smithi026.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-06-09T04:39:45.899 INFO:teuthology.orchestra.run.smithi026.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-09T04:39:45.900 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:45.900 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-06-09T04:39:46.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo useradd -m fsgqa 2023-06-09T04:39:46.110 INFO:teuthology.orchestra.run.smithi026.stderr:useradd: user 'fsgqa' already exists 2023-06-09T04:39:46.112 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:39:46.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo groupadd fsgqa 2023-06-09T04:39:46.179 INFO:teuthology.orchestra.run.smithi026.stderr:groupadd: group 'fsgqa' already exists 2023-06-09T04:39:46.180 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:39:46.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo useradd fsgqa2 2023-06-09T04:39:47.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo useradd 123456-fsgqa 2023-06-09T04:39:47.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:47.882 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:49.938 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-09T04:39:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.075+0000 7fce6521c700 1 Processor -- start 2023-06-09T04:39:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.075+0000 7fce6521c700 1 -- start start 2023-06-09T04:39:50.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce6521c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 0x7fce6015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce6521c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 0x7fce600d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce6521c700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600cf400 con 0x7fce60159d00 2023-06-09T04:39:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce6521c700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600ceec0 con 0x7fce600d0c50 2023-06-09T04:39:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce6521c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6015d830 con 0x7fce600d1840 2023-06-09T04:39:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce5e59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 0x7fce6015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce5f59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 0x7fce600d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce5e59c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 0x7fce6015d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50914/0 (socket says 172.21.15.26:50914) 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce5e59c700 1 -- 172.21.15.26:0/2707075069 learned_addr learned my addr 172.21.15.26:0/2707075069 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce5f59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 0x7fce600d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.26:47376/0 (socket says 172.21.15.26:47376) 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.076+0000 7fce5ed9d700 1 --1- 172.21.15.26:0/2707075069 >> v1:172.21.15.104:6789/0 conn(0x7fce60159d00 0x7fce600cf890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.26:48030/0 (socket says 172.21.15.26:48030) 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5e59c700 1 -- 172.21.15.26:0/2707075069 >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 msgr2=0x7fce600d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5e59c700 1 --2- 172.21.15.26:0/2707075069 >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 0x7fce600d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5e59c700 1 -- 172.21.15.26:0/2707075069 >> v1:172.21.15.104:6789/0 conn(0x7fce60159d00 legacy=0x7fce600cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5e59c700 1 -- 172.21.15.26:0/2707075069 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600cf0d0 con 0x7fce600d1840 2023-06-09T04:39:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5f59e700 1 --2- 172.21.15.26:0/2707075069 >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 0x7fce600d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:50.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5e59c700 1 --2- 172.21.15.26:0/2707075069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 0x7fce6015d2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce500098f0 tx=0x7fce50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790c1fb931bedc88 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5dd9b700 1 -- 172.21.15.26:0/2707075069 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50011830 con 0x7fce600d1840 2023-06-09T04:39:50.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5dd9b700 1 -- 172.21.15.26:0/2707075069 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50011990 con 0x7fce600d1840 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce5dd9b700 1 -- 172.21.15.26:0/2707075069 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50011d20 con 0x7fce600d1840 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce6521c700 1 -- 172.21.15.26:0/2707075069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 msgr2=0x7fce6015d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce6521c700 1 --2- 172.21.15.26:0/2707075069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 0x7fce6015d2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce500098f0 tx=0x7fce50009c00 comp rx=0 tx=0).stop 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce6521c700 1 -- 172.21.15.26:0/2707075069 shutdown_connections 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce6521c700 1 --2- 172.21.15.26:0/2707075069 >> v2:172.21.15.104:3300/0 conn(0x7fce600d0c50 0x7fce600d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.077+0000 7fce6521c700 1 --2- 172.21.15.26:0/2707075069 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce600d1840 0x7fce6015d2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.078+0000 7fce6521c700 1 -- 172.21.15.26:0/2707075069 >> 172.21.15.26:0/2707075069 conn(0x7fce600714e0 msgr2=0x7fce600718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.078+0000 7fce6521c700 1 -- 172.21.15.26:0/2707075069 shutdown_connections 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.078+0000 7fce6521c700 1 -- 172.21.15.26:0/2707075069 wait complete. 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.079+0000 7fce6521c700 1 Processor -- start 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.079+0000 7fce6521c700 1 -- start start 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce6521c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce600d0c50 0x7fce601513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce6521c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 0x7fce600b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce6521c700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce60159d00 0x7fce6014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce6521c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60152610 con 0x7fce600d1840 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce6521c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce600b7160 con 0x7fce600d0c50 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce6521c700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600b8900 con 0x7fce60159d00 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 0x7fce600b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 0x7fce600b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40264/0 (socket says 172.21.15.26:40264) 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 -- 172.21.15.26:0/920517907 learned_addr learned my addr 172.21.15.26:0/920517907 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5ed9d700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce600d0c50 0x7fce601513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5f59e700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce60159d00 0x7fce6014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 -- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce60159d00 msgr2=0x7fce6014eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce60159d00 0x7fce6014eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 -- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce600d0c50 msgr2=0x7fce601513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce600d0c50 0x7fce601513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.080+0000 7fce5e59c700 1 -- 172.21.15.26:0/920517907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009a70 con 0x7fce600d1840 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.081+0000 7fce5e59c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 0x7fce600b6c20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fce50009c40 tx=0x7fce50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.081+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500044d0 con 0x7fce600d1840 2023-06-09T04:39:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.081+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5001e070 con 0x7fce600d1840 2023-06-09T04:39:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.081+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce50009550 con 0x7fce600d1840 2023-06-09T04:39:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.081+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500038e0 con 0x7fce600d1840 2023-06-09T04:39:50.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.081+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce60151c70 con 0x7fce600d1840 2023-06-09T04:39:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.082+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce60073be0 con 0x7fce600d1840 2023-06-09T04:39:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.082+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce50003a40 con 0x7fce600d1840 2023-06-09T04:39:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.083+0000 7fce477fe700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fce4c06ace0 0x7fce4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.083+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce5008a220 con 0x7fce600d1840 2023-06-09T04:39:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.083+0000 7fce5ed9d700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fce4c06ace0 0x7fce4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.084+0000 7fce5ed9d700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fce4c06ace0 0x7fce4c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce54000fb0 tx=0x7fce54007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.087+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce50055360 con 0x7fce600d1840 2023-06-09T04:39:50.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.368+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fce60152750 con 0x7fce600d1840 2023-06-09T04:39:50.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.368+0000 7fce477fe700 1 -- 172.21.15.26:0/920517907 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fce60152750 con 0x7fce600d1840 2023-06-09T04:39:50.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:39:50.369 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":1,"fsid":"d8ea66dc-572e-4c93-a618-c44f62bf95ff","modified":"2023-06-09T04:37:19.435447Z","created":"2023-06-09T04:37:19.435447Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:3300","nonce":0},{"type":"v1","addr":"172.21.15.104:6789","nonce":0}]},"addr":"172.21.15.104:6789/0","public_addr":"172.21.15.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:3301","nonce":0},{"type":"v1","addr":"172.21.15.104:6790","nonce":0}]},"addr":"172.21.15.104:6790/0","public_addr":"172.21.15.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-09T04:39:50.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.370+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fce4c06ace0 msgr2=0x7fce4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.370+0000 7fce6521c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fce4c06ace0 0x7fce4c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce54000fb0 tx=0x7fce54007ec0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.370+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 msgr2=0x7fce600b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.370+0000 7fce6521c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 0x7fce600b6c20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fce50009c40 tx=0x7fce50004750 comp rx=0 tx=0).stop 2023-06-09T04:39:50.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 shutdown_connections 2023-06-09T04:39:50.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fce60159d00 0x7fce6014eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce600d0c50 0x7fce601513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7fce4c06ace0 0x7fce4c06d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 --2- 172.21.15.26:0/920517907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce600d1840 0x7fce600b6c20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 >> 172.21.15.26:0/920517907 conn(0x7fce600714e0 msgr2=0x7fce6015d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 shutdown_connections 2023-06-09T04:39:50.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.371+0000 7fce6521c700 1 -- 172.21.15.26:0/920517907 wait complete. 2023-06-09T04:39:50.373 INFO:teuthology.orchestra.run.smithi026.stderr:dumped monmap epoch 1 2023-06-09T04:39:50.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-06-09T04:39:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.508+0000 7f23d1f2f700 1 Processor -- start 2023-06-09T04:39:50.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.508+0000 7f23d1f2f700 1 -- start start 2023-06-09T04:39:50.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.508+0000 7f23d1f2f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.508+0000 7f23d1f2f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23cc098e30 0x7f23cc0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.508+0000 7f23d1f2f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc06f190 con 0x7f23cc06e990 2023-06-09T04:39:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23d1f2f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc06e440 con 0x7f23cc098e30 2023-06-09T04:39:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23d1f2f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc06e690 con 0x7f23cc15c6e0 2023-06-09T04:39:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cbfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f23cc098e30 0x7f23cc0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.26:50928/0 (socket says 172.21.15.26:50928) 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 -- 172.21.15.26:0/1762553015 learned_addr learned my addr 172.21.15.26:0/1762553015 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 -- 172.21.15.26:0/1762553015 >> v2:172.21.15.104:3300/0 conn(0x7f23cc098e30 msgr2=0x7f23cc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 --2- 172.21.15.26:0/1762553015 >> v2:172.21.15.104:3300/0 conn(0x7f23cc098e30 0x7f23cc0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 -- 172.21.15.26:0/1762553015 >> v1:172.21.15.104:6789/0 conn(0x7f23cc06e990 legacy=0x7f23cc0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 -- 172.21.15.26:0/1762553015 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc160300 con 0x7f23cc15c6e0 2023-06-09T04:39:50.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cbfff700 1 --2- 172.21.15.26:0/1762553015 >> v2:172.21.15.104:3300/0 conn(0x7f23cc098e30 0x7f23cc0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.509+0000 7f23cb7fe700 1 --2- 172.21.15.26:0/1762553015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0ae640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23bc006fd0 tx=0x7f23bc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39a290b6d93d74e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23ca7fc700 1 -- 172.21.15.26:0/1762553015 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc005e30 con 0x7f23cc15c6e0 2023-06-09T04:39:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23ca7fc700 1 -- 172.21.15.26:0/1762553015 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc004030 con 0x7f23cc15c6e0 2023-06-09T04:39:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23ca7fc700 1 -- 172.21.15.26:0/1762553015 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0043e0 con 0x7f23cc15c6e0 2023-06-09T04:39:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 -- 172.21.15.26:0/1762553015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 msgr2=0x7f23cc0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/1762553015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0ae640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23bc006fd0 tx=0x7f23bc009bd0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 -- 172.21.15.26:0/1762553015 shutdown_connections 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/1762553015 >> v2:172.21.15.104:3300/0 conn(0x7f23cc098e30 0x7f23cc0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/1762553015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0ae640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 -- 172.21.15.26:0/1762553015 >> 172.21.15.26:0/1762553015 conn(0x7f23cc098a30 msgr2=0x7f23cc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 -- 172.21.15.26:0/1762553015 shutdown_connections 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.510+0000 7f23d1f2f700 1 -- 172.21.15.26:0/1762553015 wait complete. 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.511+0000 7f23d1f2f700 1 Processor -- start 2023-06-09T04:39:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 -- start start 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 0x7f23cc0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23cc098e30 0x7f23cc0c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc1f33c0 con 0x7f23cc06e990 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc1f3970 con 0x7f23cc098e30 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23d1f2f700 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc1f3c10 con 0x7f23cc15c6e0 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 0x7f23cc0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 0x7f23cc0c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40276/0 (socket says 172.21.15.26:40276) 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.512+0000 7f23cb7fe700 1 -- 172.21.15.26:0/2735231859 learned_addr learned my addr 172.21.15.26:0/2735231859 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cbfff700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23caffd700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23cc098e30 0x7f23cc0c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cb7fe700 1 -- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 msgr2=0x7f23cc0c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cb7fe700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cb7fe700 1 -- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23cc098e30 msgr2=0x7f23cc0c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cb7fe700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23cc098e30 0x7f23cc0c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cb7fe700 1 -- 172.21.15.26:0/2735231859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4009a70 con 0x7f23cc06e990 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23caffd700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23cc098e30 0x7f23cc0c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23cb7fe700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 0x7f23cc0c9230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f23bc000c00 tx=0x7f23bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc003ab0 con 0x7f23cc06e990 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc003c10 con 0x7f23cc06e990 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc009500 con 0x7f23cc06e990 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc006030 con 0x7f23cc06e990 2023-06-09T04:39:50.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.513+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc1f41d0 con 0x7f23cc06e990 2023-06-09T04:39:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.514+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc067180 con 0x7f23cc06e990 2023-06-09T04:39:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.515+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23bc006190 con 0x7f23cc06e990 2023-06-09T04:39:50.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.515+0000 7f23c3fff700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23ac06ace0 0x7f23ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.515+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23bc08a5e0 con 0x7f23cc06e990 2023-06-09T04:39:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.515+0000 7f23caffd700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23ac06ace0 0x7f23ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.516+0000 7f23caffd700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23ac06ace0 0x7f23ac06d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0ca2a0 tx=0x7f23b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.519+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23bc055720 con 0x7f23cc06e990 2023-06-09T04:39:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.795+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f23cc0ce6f0 con 0x7f23cc06e990 2023-06-09T04:39:50.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.795+0000 7f23c3fff700 1 -- 172.21.15.26:0/2735231859 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f23bc058d40 con 0x7f23cc06e990 2023-06-09T04:39:50.797 INFO:teuthology.orchestra.run.smithi026.stdout:[client.admin] 2023-06-09T04:39:50.797 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB/rIJkHvFQJxAA7pAYeiK6JZ48fTWjQpji/Q== 2023-06-09T04:39:50.797 INFO:teuthology.orchestra.run.smithi026.stdout: caps mds = "allow *" 2023-06-09T04:39:50.797 INFO:teuthology.orchestra.run.smithi026.stdout: caps mgr = "allow *" 2023-06-09T04:39:50.797 INFO:teuthology.orchestra.run.smithi026.stdout: caps mon = "allow *" 2023-06-09T04:39:50.797 INFO:teuthology.orchestra.run.smithi026.stdout: caps osd = "allow *" 2023-06-09T04:39:50.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23ac06ace0 msgr2=0x7f23ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23ac06ace0 0x7f23ac06d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0ca2a0 tx=0x7f23b4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 msgr2=0x7f23cc0c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 0x7f23cc0c9230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f23bc000c00 tx=0x7f23bc004750 comp rx=0 tx=0).stop 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 shutdown_connections 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f23cc15c6e0 0x7f23cc0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:6832/83486613,v1:172.21.15.104:6833/83486613] conn(0x7f23ac06ace0 0x7f23ac06d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23cc06e990 0x7f23cc0c9230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 --2- 172.21.15.26:0/2735231859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23cc098e30 0x7f23cc0c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 >> 172.21.15.26:0/2735231859 conn(0x7f23cc098a30 msgr2=0x7f23cc0ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 shutdown_connections 2023-06-09T04:39:50.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-06-09T04:39:50.797+0000 7f23d1f2f700 1 -- 172.21.15.26:0/2735231859 wait complete. 2023-06-09T04:39:50.810 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-06-09T04:39:50.827 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.63AbPJdfRI 2023-06-09T04:39:50.827 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:39:50.828 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/tmp/tmp.63AbPJdfRI 2023-06-09T04:39:50.883 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:39:50.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/tmp/tmp.dLknDlhvfJxfstests-dev/local.config 2023-06-09T04:39:50.950 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.QgJpq9IdBDtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.R6es7WFHvvscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.26:6789 -k /tmp/tmp.63AbPJdfRI --client_mountpoint /test" 2023-06-09T04:39:50.951 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-06-09T04:39:50.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/tmp/tmp.dLknDlhvfJxfstests-dev/ceph.exclude 2023-06-09T04:39:51.018 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo make) 2023-06-09T04:39:51.102 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize -cfi 2023-06-09T04:39:51.431 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-09T04:39:51.431 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file './config.guess' 2023-06-09T04:39:51.434 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file './config.sub' 2023-06-09T04:39:51.438 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file './install-sh' 2023-06-09T04:39:51.441 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file './ltmain.sh' 2023-06-09T04:39:51.462 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-09T04:39:51.463 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-09T04:39:51.467 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-09T04:39:51.471 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-09T04:39:51.476 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-09T04:39:51.480 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-09T04:39:51.486 INFO:teuthology.orchestra.run.smithi026.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-09T04:39:51.487 INFO:teuthology.orchestra.run.smithi026.stdout:cp include/install-sh . 2023-06-09T04:39:51.488 INFO:teuthology.orchestra.run.smithi026.stdout:aclocal -I m4 2023-06-09T04:39:52.669 INFO:teuthology.orchestra.run.smithi026.stdout:autoheader 2023-06-09T04:39:52.992 INFO:teuthology.orchestra.run.smithi026.stdout:autoconf 2023-06-09T04:39:53.158 INFO:teuthology.orchestra.run.smithi026.stdout:./configure \ 2023-06-09T04:39:53.158 INFO:teuthology.orchestra.run.smithi026.stdout: --libexecdir=/usr/lib \ 2023-06-09T04:39:53.159 INFO:teuthology.orchestra.run.smithi026.stdout: --exec_prefix=/var/lib 2023-06-09T04:39:53.596 INFO:teuthology.orchestra.run.smithi026.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-09T04:39:53.596 INFO:teuthology.orchestra.run.smithi026.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-09T04:39:53.597 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to print strings... printf 2023-06-09T04:39:53.598 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gcc... gcc 2023-06-09T04:39:53.723 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether the C compiler works... yes 2023-06-09T04:39:53.724 INFO:teuthology.orchestra.run.smithi026.stdout:checking for C compiler default output file name... a.out 2023-06-09T04:39:53.752 INFO:teuthology.orchestra.run.smithi026.stdout:checking for suffix of executables... 2023-06-09T04:39:53.797 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether we are cross compiling... no 2023-06-09T04:39:53.815 INFO:teuthology.orchestra.run.smithi026.stdout:checking for suffix of object files... o 2023-06-09T04:39:53.832 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether we are using the GNU C compiler... yes 2023-06-09T04:39:53.849 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether gcc accepts -g... yes 2023-06-09T04:39:53.875 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-09T04:39:53.878 INFO:teuthology.orchestra.run.smithi026.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-09T04:39:53.880 INFO:teuthology.orchestra.run.smithi026.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-09T04:39:53.881 INFO:teuthology.orchestra.run.smithi026.stdout:checking for egrep... /bin/grep -E 2023-06-09T04:39:53.882 INFO:teuthology.orchestra.run.smithi026.stdout:checking for fgrep... /bin/grep -F 2023-06-09T04:39:53.885 INFO:teuthology.orchestra.run.smithi026.stdout:checking for ld used by gcc... /bin/ld 2023-06-09T04:39:53.887 INFO:teuthology.orchestra.run.smithi026.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-09T04:39:53.894 INFO:teuthology.orchestra.run.smithi026.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-09T04:39:53.911 INFO:teuthology.orchestra.run.smithi026.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-09T04:39:53.911 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether ln -s works... yes 2023-06-09T04:39:53.918 INFO:teuthology.orchestra.run.smithi026.stdout:checking the maximum length of command line arguments... 1572864 2023-06-09T04:39:53.920 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-09T04:39:53.920 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-09T04:39:53.921 INFO:teuthology.orchestra.run.smithi026.stdout:checking for /bin/ld option to reload object files... -r 2023-06-09T04:39:53.921 INFO:teuthology.orchestra.run.smithi026.stdout:checking for objdump... objdump 2023-06-09T04:39:53.922 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to recognize dependent libraries... pass_all 2023-06-09T04:39:53.922 INFO:teuthology.orchestra.run.smithi026.stdout:checking for dlltool... no 2023-06-09T04:39:53.923 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-09T04:39:53.923 INFO:teuthology.orchestra.run.smithi026.stdout:checking for ar... ar 2023-06-09T04:39:53.947 INFO:teuthology.orchestra.run.smithi026.stdout:checking for archiver @FILE support... @ 2023-06-09T04:39:53.947 INFO:teuthology.orchestra.run.smithi026.stdout:checking for strip... strip 2023-06-09T04:39:53.948 INFO:teuthology.orchestra.run.smithi026.stdout:checking for ranlib... ranlib 2023-06-09T04:39:53.948 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gawk... gawk 2023-06-09T04:39:53.999 INFO:teuthology.orchestra.run.smithi026.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-09T04:39:54.000 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sysroot... no 2023-06-09T04:39:54.003 INFO:teuthology.orchestra.run.smithi026.stdout:checking for a working dd... /bin/dd 2023-06-09T04:39:54.006 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-09T04:39:54.018 INFO:teuthology.orchestra.run.smithi026.stdout:checking for mt... no 2023-06-09T04:39:54.021 INFO:teuthology.orchestra.run.smithi026.stdout:checking if : is a manifest tool... no 2023-06-09T04:39:54.044 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to run the C preprocessor... gcc -E 2023-06-09T04:39:54.168 INFO:teuthology.orchestra.run.smithi026.stdout:checking for ANSI C header files... yes 2023-06-09T04:39:54.188 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/types.h... yes 2023-06-09T04:39:54.213 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/stat.h... yes 2023-06-09T04:39:54.237 INFO:teuthology.orchestra.run.smithi026.stdout:checking for stdlib.h... yes 2023-06-09T04:39:54.261 INFO:teuthology.orchestra.run.smithi026.stdout:checking for string.h... yes 2023-06-09T04:39:54.286 INFO:teuthology.orchestra.run.smithi026.stdout:checking for memory.h... yes 2023-06-09T04:39:54.311 INFO:teuthology.orchestra.run.smithi026.stdout:checking for strings.h... yes 2023-06-09T04:39:54.337 INFO:teuthology.orchestra.run.smithi026.stdout:checking for inttypes.h... yes 2023-06-09T04:39:54.362 INFO:teuthology.orchestra.run.smithi026.stdout:checking for stdint.h... yes 2023-06-09T04:39:54.390 INFO:teuthology.orchestra.run.smithi026.stdout:checking for unistd.h... yes 2023-06-09T04:39:54.416 INFO:teuthology.orchestra.run.smithi026.stdout:checking for dlfcn.h... yes 2023-06-09T04:39:54.420 INFO:teuthology.orchestra.run.smithi026.stdout:checking for objdir... .libs 2023-06-09T04:39:54.487 INFO:teuthology.orchestra.run.smithi026.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-09T04:39:54.487 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-09T04:39:54.503 INFO:teuthology.orchestra.run.smithi026.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-09T04:39:54.523 INFO:teuthology.orchestra.run.smithi026.stdout:checking if gcc static flag -static works... no 2023-06-09T04:39:54.544 INFO:teuthology.orchestra.run.smithi026.stdout:checking if gcc supports -c -o file.o... yes 2023-06-09T04:39:54.544 INFO:teuthology.orchestra.run.smithi026.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-09T04:39:54.550 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-09T04:39:54.575 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether -lc should be explicitly linked in... no 2023-06-09T04:39:54.619 INFO:teuthology.orchestra.run.smithi026.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-09T04:39:54.619 INFO:teuthology.orchestra.run.smithi026.stdout:checking how to hardcode library paths into programs... immediate 2023-06-09T04:39:54.645 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether stripping libraries is possible... yes 2023-06-09T04:39:54.646 INFO:teuthology.orchestra.run.smithi026.stdout:checking if libtool supports shared libraries... yes 2023-06-09T04:39:54.646 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether to build shared libraries... yes 2023-06-09T04:39:54.646 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether to build static libraries... yes 2023-06-09T04:39:54.650 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gcc... (cached) gcc 2023-06-09T04:39:54.666 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-09T04:39:54.666 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-09T04:39:54.666 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-09T04:39:54.666 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gmake... /usr/bin/gmake 2023-06-09T04:39:54.667 INFO:teuthology.orchestra.run.smithi026.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-09T04:39:54.667 INFO:teuthology.orchestra.run.smithi026.stdout:checking for tar... /bin/tar 2023-06-09T04:39:54.668 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gzip... /bin/gzip 2023-06-09T04:39:54.674 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether gcc -MM is supported... yes 2023-06-09T04:39:54.675 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sort... /bin/sort 2023-06-09T04:39:54.675 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether ln -s works... yes 2023-06-09T04:39:54.675 INFO:teuthology.orchestra.run.smithi026.stdout:checking for rpm... /bin/rpm 2023-06-09T04:39:54.679 INFO:teuthology.orchestra.run.smithi026.stdout:checking for rpmbuild... no 2023-06-09T04:39:54.704 INFO:teuthology.orchestra.run.smithi026.stdout:checking assert.h usability... yes 2023-06-09T04:39:54.711 INFO:teuthology.orchestra.run.smithi026.stdout:checking assert.h presence... yes 2023-06-09T04:39:54.711 INFO:teuthology.orchestra.run.smithi026.stdout:checking for assert.h... yes 2023-06-09T04:39:54.737 INFO:teuthology.orchestra.run.smithi026.stdout:checking bstring.h usability... no 2023-06-09T04:39:54.747 INFO:teuthology.orchestra.run.smithi026.stdout:checking bstring.h presence... no 2023-06-09T04:39:54.747 INFO:teuthology.orchestra.run.smithi026.stdout:checking for bstring.h... no 2023-06-09T04:39:54.771 INFO:teuthology.orchestra.run.smithi026.stdout:checking libgen.h usability... yes 2023-06-09T04:39:54.778 INFO:teuthology.orchestra.run.smithi026.stdout:checking libgen.h presence... yes 2023-06-09T04:39:54.778 INFO:teuthology.orchestra.run.smithi026.stdout:checking for libgen.h... yes 2023-06-09T04:39:54.806 INFO:teuthology.orchestra.run.smithi026.stdout:checking dirent.h usability... yes 2023-06-09T04:39:54.814 INFO:teuthology.orchestra.run.smithi026.stdout:checking dirent.h presence... yes 2023-06-09T04:39:54.814 INFO:teuthology.orchestra.run.smithi026.stdout:checking for dirent.h... yes 2023-06-09T04:39:54.863 INFO:teuthology.orchestra.run.smithi026.stdout:checking errno.h usability... yes 2023-06-09T04:39:54.870 INFO:teuthology.orchestra.run.smithi026.stdout:checking errno.h presence... yes 2023-06-09T04:39:54.870 INFO:teuthology.orchestra.run.smithi026.stdout:checking for errno.h... yes 2023-06-09T04:39:54.899 INFO:teuthology.orchestra.run.smithi026.stdout:checking malloc.h usability... yes 2023-06-09T04:39:54.907 INFO:teuthology.orchestra.run.smithi026.stdout:checking malloc.h presence... yes 2023-06-09T04:39:54.907 INFO:teuthology.orchestra.run.smithi026.stdout:checking for malloc.h... yes 2023-06-09T04:39:54.950 INFO:teuthology.orchestra.run.smithi026.stdout:checking uuid.h usability... no 2023-06-09T04:39:54.976 INFO:teuthology.orchestra.run.smithi026.stdout:checking uuid.h presence... no 2023-06-09T04:39:54.976 INFO:teuthology.orchestra.run.smithi026.stdout:checking for uuid.h... no 2023-06-09T04:39:55.003 INFO:teuthology.orchestra.run.smithi026.stdout:checking uuid/uuid.h usability... yes 2023-06-09T04:39:55.011 INFO:teuthology.orchestra.run.smithi026.stdout:checking uuid/uuid.h presence... yes 2023-06-09T04:39:55.012 INFO:teuthology.orchestra.run.smithi026.stdout:checking for uuid/uuid.h... yes 2023-06-09T04:39:55.037 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/uuid.h usability... no 2023-06-09T04:39:55.047 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/uuid.h presence... no 2023-06-09T04:39:55.047 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/uuid.h... no 2023-06-09T04:39:55.086 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/file.h usability... yes 2023-06-09T04:39:55.094 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/file.h presence... yes 2023-06-09T04:39:55.094 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/file.h... yes 2023-06-09T04:39:55.122 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/fcntl.h usability... yes 2023-06-09T04:39:55.129 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/fcntl.h presence... yes 2023-06-09T04:39:55.129 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/fcntl.h... yes 2023-06-09T04:39:55.156 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/syssgi.h usability... no 2023-06-09T04:39:55.166 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/syssgi.h presence... no 2023-06-09T04:39:55.166 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/syssgi.h... no 2023-06-09T04:39:55.214 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/param.h usability... yes 2023-06-09T04:39:55.224 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/param.h presence... yes 2023-06-09T04:39:55.224 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/param.h... yes 2023-06-09T04:39:55.229 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/stat.h... (cached) yes 2023-06-09T04:39:55.257 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/statvfs.h usability... yes 2023-06-09T04:39:55.264 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/statvfs.h presence... yes 2023-06-09T04:39:55.265 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/statvfs.h... yes 2023-06-09T04:39:55.292 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/time.h usability... yes 2023-06-09T04:39:55.299 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/time.h presence... yes 2023-06-09T04:39:55.299 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/time.h... yes 2023-06-09T04:39:55.338 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/ioctl.h usability... yes 2023-06-09T04:39:55.346 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/ioctl.h presence... yes 2023-06-09T04:39:55.346 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/ioctl.h... yes 2023-06-09T04:39:55.375 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/wait.h usability... yes 2023-06-09T04:39:55.384 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/wait.h presence... yes 2023-06-09T04:39:55.384 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/wait.h... yes 2023-06-09T04:39:55.389 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/types.h... (cached) yes 2023-06-09T04:39:55.394 INFO:teuthology.orchestra.run.smithi026.stdout:checking for strings.h... (cached) yes 2023-06-09T04:39:55.431 INFO:teuthology.orchestra.run.smithi026.stdout:checking err.h usability... yes 2023-06-09T04:39:55.438 INFO:teuthology.orchestra.run.smithi026.stdout:checking err.h presence... yes 2023-06-09T04:39:55.439 INFO:teuthology.orchestra.run.smithi026.stdout:checking for err.h... yes 2023-06-09T04:39:55.475 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/falloc.h usability... yes 2023-06-09T04:39:55.481 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/falloc.h presence... yes 2023-06-09T04:39:55.481 INFO:teuthology.orchestra.run.smithi026.stdout:checking for linux/falloc.h... yes 2023-06-09T04:39:55.508 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-09T04:39:55.517 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-09T04:39:55.517 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-09T04:39:55.541 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-09T04:39:55.551 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-09T04:39:55.551 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-09T04:39:55.574 INFO:teuthology.orchestra.run.smithi026.stdout:checking xfs/platform_defs.h usability... no 2023-06-09T04:39:55.584 INFO:teuthology.orchestra.run.smithi026.stdout:checking xfs/platform_defs.h presence... no 2023-06-09T04:39:55.584 INFO:teuthology.orchestra.run.smithi026.stdout:checking for xfs/platform_defs.h... no 2023-06-09T04:39:55.607 INFO:teuthology.orchestra.run.smithi026.stdout:checking btrfs/ioctl.h usability... no 2023-06-09T04:39:55.616 INFO:teuthology.orchestra.run.smithi026.stdout:checking btrfs/ioctl.h presence... no 2023-06-09T04:39:55.617 INFO:teuthology.orchestra.run.smithi026.stdout:checking for btrfs/ioctl.h... no 2023-06-09T04:39:55.640 INFO:teuthology.orchestra.run.smithi026.stdout:checking cifs/ioctl.h usability... no 2023-06-09T04:39:55.649 INFO:teuthology.orchestra.run.smithi026.stdout:checking cifs/ioctl.h presence... no 2023-06-09T04:39:55.649 INFO:teuthology.orchestra.run.smithi026.stdout:checking for cifs/ioctl.h... no 2023-06-09T04:39:55.675 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/mman.h usability... yes 2023-06-09T04:39:55.682 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/mman.h presence... yes 2023-06-09T04:39:55.682 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/mman.h... yes 2023-06-09T04:39:55.697 INFO:teuthology.orchestra.run.smithi026.stdout:checking for xfs/xfs_log_format.h... no 2023-06-09T04:39:55.732 INFO:teuthology.orchestra.run.smithi026.stdout:checking for uuid_compare... no 2023-06-09T04:39:55.762 INFO:teuthology.orchestra.run.smithi026.stdout:checking for uuid_compare in -luuid... yes 2023-06-09T04:39:55.809 INFO:teuthology.orchestra.run.smithi026.stdout:checking for xfs/xfs.h... yes 2023-06-09T04:39:55.823 INFO:teuthology.orchestra.run.smithi026.stdout:checking for xfs/libxfs.h... no 2023-06-09T04:39:55.838 INFO:teuthology.orchestra.run.smithi026.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-09T04:39:55.866 INFO:teuthology.orchestra.run.smithi026.stdout:checking for xfs/xqm.h... yes 2023-06-09T04:39:55.913 INFO:teuthology.orchestra.run.smithi026.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-09T04:39:55.936 INFO:teuthology.orchestra.run.smithi026.stdout:checking xfs/handle.h usability... yes 2023-06-09T04:39:55.942 INFO:teuthology.orchestra.run.smithi026.stdout:checking xfs/handle.h presence... yes 2023-06-09T04:39:55.942 INFO:teuthology.orchestra.run.smithi026.stdout:checking for xfs/handle.h... yes 2023-06-09T04:39:55.985 INFO:teuthology.orchestra.run.smithi026.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-09T04:39:56.028 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/acl.h usability... yes 2023-06-09T04:39:56.036 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/acl.h presence... yes 2023-06-09T04:39:56.036 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/acl.h... yes 2023-06-09T04:39:56.062 INFO:teuthology.orchestra.run.smithi026.stdout:checking acl/libacl.h usability... yes 2023-06-09T04:39:56.071 INFO:teuthology.orchestra.run.smithi026.stdout:checking acl/libacl.h presence... yes 2023-06-09T04:39:56.071 INFO:teuthology.orchestra.run.smithi026.stdout:checking for acl/libacl.h... yes 2023-06-09T04:39:56.103 INFO:teuthology.orchestra.run.smithi026.stdout:checking for acl_init in -lacl... yes 2023-06-09T04:39:56.126 INFO:teuthology.orchestra.run.smithi026.stdout:checking gdbm-ndbm.h usability... no 2023-06-09T04:39:56.136 INFO:teuthology.orchestra.run.smithi026.stdout:checking gdbm-ndbm.h presence... no 2023-06-09T04:39:56.136 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gdbm-ndbm.h... no 2023-06-09T04:39:56.157 INFO:teuthology.orchestra.run.smithi026.stdout:checking gdbm/ndbm.h usability... no 2023-06-09T04:39:56.167 INFO:teuthology.orchestra.run.smithi026.stdout:checking gdbm/ndbm.h presence... no 2023-06-09T04:39:56.167 INFO:teuthology.orchestra.run.smithi026.stdout:checking for gdbm/ndbm.h... no 2023-06-09T04:39:56.188 INFO:teuthology.orchestra.run.smithi026.stdout:checking ndbm.h usability... no 2023-06-09T04:39:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:checking ndbm.h presence... no 2023-06-09T04:39:56.198 INFO:teuthology.orchestra.run.smithi026.stdout:checking for ndbm.h... no 2023-06-09T04:39:56.224 INFO:teuthology.orchestra.run.smithi026.stdout:checking libaio.h usability... yes 2023-06-09T04:39:56.234 INFO:teuthology.orchestra.run.smithi026.stdout:checking libaio.h presence... yes 2023-06-09T04:39:56.234 INFO:teuthology.orchestra.run.smithi026.stdout:checking for libaio.h... yes 2023-06-09T04:39:56.256 INFO:teuthology.orchestra.run.smithi026.stdout:checking liburing.h usability... no 2023-06-09T04:39:56.266 INFO:teuthology.orchestra.run.smithi026.stdout:checking liburing.h presence... no 2023-06-09T04:39:56.266 INFO:teuthology.orchestra.run.smithi026.stdout:checking for liburing.h... no 2023-06-09T04:39:56.288 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/capability.h usability... no 2023-06-09T04:39:56.297 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/capability.h presence... no 2023-06-09T04:39:56.298 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/capability.h... no 2023-06-09T04:39:56.321 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/fiemap.h usability... yes 2023-06-09T04:39:56.328 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/fiemap.h presence... yes 2023-06-09T04:39:56.328 INFO:teuthology.orchestra.run.smithi026.stdout:checking for linux/fiemap.h... yes 2023-06-09T04:39:56.361 INFO:teuthology.orchestra.run.smithi026.stdout:checking for fallocate... yes 2023-06-09T04:39:56.394 INFO:teuthology.orchestra.run.smithi026.stdout:checking for open_by_handle_at... yes 2023-06-09T04:39:56.418 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/prctl.h usability... yes 2023-06-09T04:39:56.426 INFO:teuthology.orchestra.run.smithi026.stdout:checking sys/prctl.h presence... yes 2023-06-09T04:39:56.426 INFO:teuthology.orchestra.run.smithi026.stdout:checking for sys/prctl.h... yes 2023-06-09T04:39:56.450 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/fs.h usability... yes 2023-06-09T04:39:56.457 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/fs.h presence... yes 2023-06-09T04:39:56.458 INFO:teuthology.orchestra.run.smithi026.stdout:checking for linux/fs.h... yes 2023-06-09T04:39:56.479 INFO:teuthology.orchestra.run.smithi026.stdout:checking btrfsutil.h usability... no 2023-06-09T04:39:56.488 INFO:teuthology.orchestra.run.smithi026.stdout:checking btrfsutil.h presence... no 2023-06-09T04:39:56.489 INFO:teuthology.orchestra.run.smithi026.stdout:checking for btrfsutil.h... no 2023-06-09T04:39:56.524 INFO:teuthology.orchestra.run.smithi026.stdout:checking for copy_file_range... yes 2023-06-09T04:39:56.559 INFO:teuthology.orchestra.run.smithi026.stdout:checking for SEEK_DATA... yes 2023-06-09T04:39:56.605 INFO:teuthology.orchestra.run.smithi026.stdout:checking for BMV_OF_SHARED... yes 2023-06-09T04:39:56.640 INFO:teuthology.orchestra.run.smithi026.stdout:checking for nftw... yes 2023-06-09T04:39:56.675 INFO:teuthology.orchestra.run.smithi026.stdout:checking for RLIMIT_NOFILE... yes 2023-06-09T04:39:56.692 INFO:teuthology.orchestra.run.smithi026.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-09T04:39:56.724 INFO:teuthology.orchestra.run.smithi026.stdout:checking for renameat2... yes 2023-06-09T04:39:56.757 INFO:teuthology.orchestra.run.smithi026.stdout:checking for reallocarray... yes 2023-06-09T04:39:56.771 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct mount_attr... no 2023-06-09T04:39:56.804 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-09T04:39:56.838 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-09T04:39:56.873 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-09T04:39:56.907 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-09T04:39:56.942 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-09T04:39:56.976 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-09T04:39:57.011 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-09T04:39:57.037 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/btrfs.h usability... yes 2023-06-09T04:39:57.045 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/btrfs.h presence... yes 2023-06-09T04:39:57.045 INFO:teuthology.orchestra.run.smithi026.stdout:checking for linux/btrfs.h... yes 2023-06-09T04:39:57.074 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-09T04:39:57.082 INFO:teuthology.orchestra.run.smithi026.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-09T04:39:57.082 INFO:teuthology.orchestra.run.smithi026.stdout:checking for linux/btrfs_tree.h... yes 2023-06-09T04:39:57.113 INFO:teuthology.orchestra.run.smithi026.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-09T04:39:57.130 INFO:teuthology.orchestra.run.smithi026.stdout:configure: creating ./config.status 2023-06-09T04:39:57.436 INFO:teuthology.orchestra.run.smithi026.stdout:config.status: creating include/builddefs 2023-06-09T04:39:57.446 INFO:teuthology.orchestra.run.smithi026.stdout:config.status: creating include/config.h 2023-06-09T04:39:57.454 INFO:teuthology.orchestra.run.smithi026.stdout:config.status: executing libtool commands 2023-06-09T04:39:57.492 INFO:teuthology.orchestra.run.smithi026.stdout:Building include 2023-06-09T04:39:57.496 INFO:teuthology.orchestra.run.smithi026.stdout:Building lib 2023-06-09T04:39:57.498 INFO:teuthology.orchestra.run.smithi026.stdout: [LTDEP] 2023-06-09T04:39:57.603 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dataascii.lo 2023-06-09T04:39:57.718 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] databin.lo 2023-06-09T04:39:57.859 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] datapid.lo 2023-06-09T04:39:57.958 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] file_lock.lo 2023-06-09T04:39:58.098 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] forker.lo 2023-06-09T04:39:58.226 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] pattern.lo 2023-06-09T04:39:58.343 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] open_flags.lo 2023-06-09T04:39:58.478 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] random_range.lo 2023-06-09T04:39:58.693 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] string_to_tokens.lo 2023-06-09T04:39:58.794 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] str_to_bytes.lo 2023-06-09T04:39:58.918 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] tlibio.lo 2023-06-09T04:39:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] write_log.lo 2023-06-09T04:39:59.366 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] random.lo 2023-06-09T04:39:59.485 INFO:teuthology.orchestra.run.smithi026.stdout: [LD] 2023-06-09T04:39:59.557 INFO:teuthology.orchestra.run.smithi026.stdout:Building ltp 2023-06-09T04:39:59.560 INFO:teuthology.orchestra.run.smithi026.stdout: [DEP] 2023-06-09T04:39:59.670 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] doio 2023-06-09T04:40:00.288 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fsstress 2023-06-09T04:40:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fsx 2023-06-09T04:40:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] growfiles 2023-06-09T04:40:02.830 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] iogen 2023-06-09T04:40:03.164 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-stress 2023-06-09T04:40:03.556 INFO:teuthology.orchestra.run.smithi026.stdout:Building src 2023-06-09T04:40:03.561 INFO:teuthology.orchestra.run.smithi026.stdout: [DEP] 2023-06-09T04:40:04.939 INFO:teuthology.orchestra.run.smithi026.stdout: [DEP] 2023-06-09T04:40:04.965 INFO:teuthology.orchestra.run.smithi026.stdout: [DEP] 2023-06-09T04:40:04.973 INFO:teuthology.orchestra.run.smithi026.stdout: [DEP] 2023-06-09T04:40:05.162 INFO:teuthology.orchestra.run.smithi026.stdout: [DEP] 2023-06-09T04:40:05.183 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dirstress 2023-06-09T04:40:05.403 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fill 2023-06-09T04:40:05.548 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fill2 2023-06-09T04:40:05.760 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] getpagesize 2023-06-09T04:40:05.889 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] holes 2023-06-09T04:40:06.070 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] lstat64 2023-06-09T04:40:06.242 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] nametest 2023-06-09T04:40:06.464 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] permname 2023-06-09T04:40:06.649 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] randholes 2023-06-09T04:40:06.882 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] runas 2023-06-09T04:40:07.046 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] truncfile 2023-06-09T04:40:07.214 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] usemem 2023-06-09T04:40:07.355 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] mmapcat 2023-06-09T04:40:07.495 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] append_reader 2023-06-09T04:40:07.637 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] append_writer 2023-06-09T04:40:07.778 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dirperf 2023-06-09T04:40:07.983 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] metaperf 2023-06-09T04:40:08.220 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] devzero 2023-06-09T04:40:08.383 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] feature 2023-06-09T04:40:08.585 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] alloc 2023-06-09T04:40:08.781 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fault 2023-06-09T04:40:08.935 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fstest 2023-06-09T04:40:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_access_root 2023-06-09T04:40:09.302 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] godown 2023-06-09T04:40:09.460 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] resvtest 2023-06-09T04:40:09.632 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] writemod 2023-06-09T04:40:09.770 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] writev_on_pagefault 2023-06-09T04:40:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] makeextents 2023-06-09T04:40:10.086 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] itrash 2023-06-09T04:40:10.233 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] rename 2023-06-09T04:40:10.365 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] multi_open_unlink 2023-06-09T04:40:10.519 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] unwritten_sync 2023-06-09T04:40:10.693 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] genhashnames 2023-06-09T04:40:10.869 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_holes 2023-06-09T04:40:11.007 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_writev 2023-06-09T04:40:11.147 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_truncate_cmtime 2023-06-09T04:40:11.296 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dirhash_collide 2023-06-09T04:40:11.465 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_rename_overwrite 2023-06-09T04:40:11.599 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] holetest 2023-06-09T04:40:11.804 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_truncate_self 2023-06-09T04:40:11.936 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] af_unix 2023-06-09T04:40:12.080 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_stale_pmd 2023-06-09T04:40:12.224 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_cow_race 2023-06-09T04:40:12.378 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_fallocate 2023-06-09T04:40:12.520 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fsync-err 2023-06-09T04:40:12.694 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_write_ro 2023-06-09T04:40:12.836 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-09T04:40:12.986 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-09T04:40:13.132 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_ofd_locks 2023-06-09T04:40:13.320 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_collision 2023-06-09T04:40:13.505 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] mmap-write-concurrent 2023-06-09T04:40:13.666 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_get_file_time 2023-06-09T04:40:13.804 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_create_short_dirs 2023-06-09T04:40:13.961 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_create_long_dirs 2023-06-09T04:40:14.115 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_enospc 2023-06-09T04:40:14.290 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_writev_overlap 2023-06-09T04:40:14.448 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] checkpoint_journal 2023-06-09T04:40:14.594 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] mmap-rw-fault 2023-06-09T04:40:14.762 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] allocstale 2023-06-09T04:40:14.919 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_cow_memory_failure 2023-06-09T04:40:15.079 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fake-dump-rootino 2023-06-09T04:40:15.220 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dio-buf-fault 2023-06-09T04:40:15.366 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] xfsctl 2023-06-09T04:40:15.541 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] bstat 2023-06-09T04:40:15.731 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mtab 2023-06-09T04:40:15.903 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] getdevicesize 2023-06-09T04:40:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] preallo_rw_pattern_reader 2023-06-09T04:40:16.198 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] preallo_rw_pattern_writer 2023-06-09T04:40:16.348 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] ftrunc 2023-06-09T04:40:16.488 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] trunc 2023-06-09T04:40:16.639 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fs_perms 2023-06-09T04:40:16.793 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] testx 2023-06-09T04:40:16.919 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] looptest 2023-06-09T04:40:17.101 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] locktest 2023-06-09T04:40:17.389 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] unwritten_mmap 2023-06-09T04:40:17.542 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] bulkstat_unlink_test 2023-06-09T04:40:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] deduperace 2023-06-09T04:40:17.912 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] bulkstat_unlink_test_modified 2023-06-09T04:40:18.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:18.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:18.098 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_dir_offset 2023-06-09T04:40:18.239 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_futimens 2023-06-09T04:40:18.373 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_immutable 2023-06-09T04:40:18.943 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] stale_handle 2023-06-09T04:40:19.102 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] pwrite_mmap_blocked 2023-06-09T04:40:19.247 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_dir_offset2 2023-06-09T04:40:19.427 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] seek_sanity_test 2023-06-09T04:40:19.815 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] seek_copy_test 2023-06-09T04:40:19.981 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_readdir_1 2023-06-09T04:40:20.121 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_readdir_2 2023-06-09T04:40:20.264 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fsync-tester 2023-06-09T04:40:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] nsexec 2023-06-09T04:40:20.662 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] cloner 2023-06-09T04:40:20.829 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] renameat2 2023-06-09T04:40:20.984 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_getcwd 2023-06-09T04:40:21.133 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] e4compact 2023-06-09T04:40:21.392 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] test-nextquota 2023-06-09T04:40:21.553 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] punch-alternating 2023-06-09T04:40:21.713 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-09T04:40:21.869 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] listxattr 2023-06-09T04:40:22.009 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dio-interleaved 2023-06-09T04:40:22.160 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_dir_type 2023-06-09T04:40:22.307 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] dio-invalidate-cache 2023-06-09T04:40:22.497 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] stat_test 2023-06-09T04:40:22.776 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_encrypted_d_revalidate 2023-06-09T04:40:22.932 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] attr_replace_test 2023-06-09T04:40:23.085 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] swapon 2023-06-09T04:40:23.241 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] mkswap 2023-06-09T04:40:23.385 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_attr_corruption 2023-06-09T04:40:23.527 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_open_tmpfiles 2023-06-09T04:40:23.694 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fscrypt-crypt-util 2023-06-09T04:40:24.294 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] bulkstat_null_ocount 2023-06-09T04:40:24.443 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] splice-test 2023-06-09T04:40:24.612 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] chprojid_fail 2023-06-09T04:40:24.765 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] detached_mounts_propagation 2023-06-09T04:40:24.937 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] ext4_resize 2023-06-09T04:40:25.078 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_readdir_3 2023-06-09T04:40:25.263 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] splice2pipe 2023-06-09T04:40:25.418 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] uuid_ioctl 2023-06-09T04:40:25.562 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fiemap-tester 2023-06-09T04:40:25.814 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_stripealign 2023-06-09T04:40:25.958 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] open_by_handle 2023-06-09T04:40:26.196 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] t_mmap_dio 2023-06-09T04:40:26.350 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] xfsfind 2023-06-09T04:40:26.531 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] fssum 2023-06-09T04:40:26.935 INFO:teuthology.orchestra.run.smithi026.stdout:Building log-writes 2023-06-09T04:40:26.940 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] replay-log 2023-06-09T04:40:27.231 INFO:teuthology.orchestra.run.smithi026.stdout:Building perf 2023-06-09T04:40:27.235 INFO:teuthology.orchestra.run.smithi026.stdout:Building aio-dio-regress 2023-06-09T04:40:27.240 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-09T04:40:27.404 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-fcntl-race 2023-06-09T04:40:27.560 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-subblock-eof-read 2023-06-09T04:40:27.698 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-append-write-read-race 2023-06-09T04:40:27.865 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-invalidate-readahead 2023-06-09T04:40:28.022 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-write-verify 2023-06-09T04:40:28.207 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-09T04:40:28.338 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-last-ref-held-by-io 2023-06-09T04:40:28.503 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-cycle-write 2023-06-09T04:40:28.680 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-extend-stat 2023-06-09T04:40:28.838 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-09T04:40:28.968 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-hole-filling-race 2023-06-09T04:40:29.112 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-invalidate-failure 2023-06-09T04:40:29.265 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aiodio_sparse2 2023-06-09T04:40:29.471 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aiocp 2023-06-09T04:40:29.684 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-cow-race 2023-06-09T04:40:29.832 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] aio-dio-eof-race 2023-06-09T04:40:30.007 INFO:teuthology.orchestra.run.smithi026.stdout:Building vfs 2023-06-09T04:40:30.012 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] vfstest 2023-06-09T04:40:31.759 INFO:teuthology.orchestra.run.smithi026.stdout: [CC] mount-idmapped 2023-06-09T04:40:32.104 INFO:teuthology.orchestra.run.smithi026.stdout:Building m4 2023-06-09T04:40:32.107 INFO:teuthology.orchestra.run.smithi026.stdout:Building common 2023-06-09T04:40:32.110 INFO:teuthology.orchestra.run.smithi026.stdout:Building tests 2023-06-09T04:40:32.115 INFO:teuthology.orchestra.run.smithi026.stdout:Building perf 2023-06-09T04:40:32.120 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/perf/group.list 2023-06-09T04:40:32.131 INFO:teuthology.orchestra.run.smithi026.stdout:Building ext4 2023-06-09T04:40:32.136 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ext4/group.list 2023-06-09T04:40:32.171 INFO:teuthology.orchestra.run.smithi026.stdout:Building ocfs2 2023-06-09T04:40:32.176 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ocfs2/group.list 2023-06-09T04:40:32.188 INFO:teuthology.orchestra.run.smithi026.stdout:Building overlay 2023-06-09T04:40:32.193 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/overlay/group.list 2023-06-09T04:40:32.228 INFO:teuthology.orchestra.run.smithi026.stdout:Building cifs 2023-06-09T04:40:32.233 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/cifs/group.list 2023-06-09T04:40:32.244 INFO:teuthology.orchestra.run.smithi026.stdout:Building generic 2023-06-09T04:40:32.251 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/generic/group.list 2023-06-09T04:40:32.343 INFO:teuthology.orchestra.run.smithi026.stdout:Building shared 2023-06-09T04:40:32.348 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/shared/group.list 2023-06-09T04:40:32.363 INFO:teuthology.orchestra.run.smithi026.stdout:Building nfs 2023-06-09T04:40:32.368 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/nfs/group.list 2023-06-09T04:40:32.381 INFO:teuthology.orchestra.run.smithi026.stdout:Building f2fs 2023-06-09T04:40:32.388 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/f2fs/group.list 2023-06-09T04:40:32.402 INFO:teuthology.orchestra.run.smithi026.stdout:Building udf 2023-06-09T04:40:32.407 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/udf/group.list 2023-06-09T04:40:32.417 INFO:teuthology.orchestra.run.smithi026.stdout:Building ceph 2023-06-09T04:40:32.422 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ceph/group.list 2023-06-09T04:40:32.435 INFO:teuthology.orchestra.run.smithi026.stdout:Building xfs 2023-06-09T04:40:32.441 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/xfs/group.list 2023-06-09T04:40:32.535 INFO:teuthology.orchestra.run.smithi026.stdout:Building btrfs 2023-06-09T04:40:32.540 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/btrfs/group.list 2023-06-09T04:40:32.595 INFO:teuthology.orchestra.run.smithi026.stdout:Building tmpfs 2023-06-09T04:40:32.600 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/tmpfs/group.list 2023-06-09T04:40:32.612 INFO:teuthology.orchestra.run.smithi026.stdout:Building selftest 2023-06-09T04:40:32.617 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/selftest/group.list 2023-06-09T04:40:32.631 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo make install) 2023-06-09T04:40:32.710 INFO:teuthology.orchestra.run.smithi026.stdout:Building include 2023-06-09T04:40:32.713 INFO:teuthology.orchestra.run.smithi026.stdout:Building lib 2023-06-09T04:40:32.717 INFO:teuthology.orchestra.run.smithi026.stdout:Building ltp 2023-06-09T04:40:32.721 INFO:teuthology.orchestra.run.smithi026.stdout:Building src 2023-06-09T04:40:32.754 INFO:teuthology.orchestra.run.smithi026.stdout:Building log-writes 2023-06-09T04:40:32.757 INFO:teuthology.orchestra.run.smithi026.stdout:Building perf 2023-06-09T04:40:32.760 INFO:teuthology.orchestra.run.smithi026.stdout:Building aio-dio-regress 2023-06-09T04:40:32.764 INFO:teuthology.orchestra.run.smithi026.stdout:Building vfs 2023-06-09T04:40:32.768 INFO:teuthology.orchestra.run.smithi026.stdout:Building m4 2023-06-09T04:40:32.772 INFO:teuthology.orchestra.run.smithi026.stdout:Building common 2023-06-09T04:40:32.775 INFO:teuthology.orchestra.run.smithi026.stdout:Building tests 2023-06-09T04:40:32.780 INFO:teuthology.orchestra.run.smithi026.stdout:Building perf 2023-06-09T04:40:32.785 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/perf/group.list 2023-06-09T04:40:32.796 INFO:teuthology.orchestra.run.smithi026.stdout:Building ext4 2023-06-09T04:40:32.801 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ext4/group.list 2023-06-09T04:40:32.834 INFO:teuthology.orchestra.run.smithi026.stdout:Building ocfs2 2023-06-09T04:40:32.839 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ocfs2/group.list 2023-06-09T04:40:32.852 INFO:teuthology.orchestra.run.smithi026.stdout:Building overlay 2023-06-09T04:40:32.857 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/overlay/group.list 2023-06-09T04:40:32.891 INFO:teuthology.orchestra.run.smithi026.stdout:Building cifs 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/cifs/group.list 2023-06-09T04:40:32.908 INFO:teuthology.orchestra.run.smithi026.stdout:Building generic 2023-06-09T04:40:32.914 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/generic/group.list 2023-06-09T04:40:33.004 INFO:teuthology.orchestra.run.smithi026.stdout:Building shared 2023-06-09T04:40:33.009 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/shared/group.list 2023-06-09T04:40:33.025 INFO:teuthology.orchestra.run.smithi026.stdout:Building nfs 2023-06-09T04:40:33.030 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/nfs/group.list 2023-06-09T04:40:33.043 INFO:teuthology.orchestra.run.smithi026.stdout:Building f2fs 2023-06-09T04:40:33.048 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/f2fs/group.list 2023-06-09T04:40:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:Building udf 2023-06-09T04:40:33.068 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/udf/group.list 2023-06-09T04:40:33.079 INFO:teuthology.orchestra.run.smithi026.stdout:Building ceph 2023-06-09T04:40:33.084 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ceph/group.list 2023-06-09T04:40:33.097 INFO:teuthology.orchestra.run.smithi026.stdout:Building xfs 2023-06-09T04:40:33.103 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/xfs/group.list 2023-06-09T04:40:33.194 INFO:teuthology.orchestra.run.smithi026.stdout:Building btrfs 2023-06-09T04:40:33.200 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/btrfs/group.list 2023-06-09T04:40:33.254 INFO:teuthology.orchestra.run.smithi026.stdout:Building tmpfs 2023-06-09T04:40:33.259 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/tmpfs/group.list 2023-06-09T04:40:33.271 INFO:teuthology.orchestra.run.smithi026.stdout:Building selftest 2023-06-09T04:40:33.276 INFO:teuthology.orchestra.run.smithi026.stdout: [GROUP] /tmp/tmp.dLknDlhvfJxfstests-dev/tests/selftest/group.list 2023-06-09T04:40:33.287 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-09T04:40:33.289 INFO:teuthology.orchestra.run.smithi026.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:40:33.289 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-09T04:40:33.291 INFO:teuthology.orchestra.run.smithi026.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:40:33.291 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-09T04:40:33.293 INFO:teuthology.orchestra.run.smithi026.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-09T04:40:33.302 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-09T04:40:33.380 INFO:teuthology.orchestra.run.smithi026.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-09T04:40:33.389 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-09T04:40:33.406 INFO:teuthology.orchestra.run.smithi026.stdout:Building log-writes 2023-06-09T04:40:33.409 INFO:teuthology.orchestra.run.smithi026.stdout:Building perf 2023-06-09T04:40:33.412 INFO:teuthology.orchestra.run.smithi026.stdout:Building aio-dio-regress 2023-06-09T04:40:33.416 INFO:teuthology.orchestra.run.smithi026.stdout:Building vfs 2023-06-09T04:40:33.419 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake -C log-writes install 2023-06-09T04:40:33.421 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-09T04:40:33.430 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-09T04:40:33.439 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake -C perf install 2023-06-09T04:40:33.440 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-09T04:40:33.449 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-09T04:40:33.472 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-09T04:40:33.474 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:40:33.483 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:40:33.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake -C vfs install 2023-06-09T04:40:33.538 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-09T04:40:33.547 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-09T04:40:33.559 INFO:teuthology.orchestra.run.smithi026.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-09T04:40:33.568 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-09T04:40:34.791 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-09T04:40:34.886 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-09T04:40:34.918 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-09T04:40:34.920 INFO:teuthology.orchestra.run.smithi026.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:40:34.920 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-09T04:40:34.921 INFO:teuthology.orchestra.run.smithi026.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-09T04:40:34.933 INFO:teuthology.orchestra.run.smithi026.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-09T04:40:35.069 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-09T04:40:35.070 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/btrfs/ install 2023-06-09T04:40:35.073 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:35.082 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:35.892 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:35.901 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:36.720 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ceph/ install 2023-06-09T04:40:36.722 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-09T04:40:36.731 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-09T04:40:36.751 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-09T04:40:36.759 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-09T04:40:36.780 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/cifs/ install 2023-06-09T04:40:36.781 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-09T04:40:36.790 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-09T04:40:36.800 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-09T04:40:36.808 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-09T04:40:36.817 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ext4/ install 2023-06-09T04:40:36.819 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-09T04:40:36.828 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-09T04:40:37.025 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-09T04:40:37.034 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-09T04:40:37.240 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/f2fs/ install 2023-06-09T04:40:37.242 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:37.251 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:37.262 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:37.271 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:37.283 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/generic/ install 2023-06-09T04:40:37.287 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-09T04:40:37.296 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-09T04:40:39.345 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-09T04:40:39.354 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 555.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 255.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 645.out 673.out 190.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 309.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 342.out 041.out 664.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 599.out 476.out 087.out 199.out 458.out 233.out 639.out 721.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 451.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 382.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 044.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 519.out 567.out 299.out 474.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 443.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 357.out 072.out 068.out 229.out 038.out 084.out 056.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 308.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 097.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out /var/lib/xfstests/tests/generic 2023-06-09T04:40:41.431 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/nfs/ install 2023-06-09T04:40:41.433 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-09T04:40:41.441 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-09T04:40:41.450 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-09T04:40:41.459 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-09T04:40:41.468 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/ocfs2/ install 2023-06-09T04:40:41.469 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-09T04:40:41.478 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-09T04:40:41.487 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-09T04:40:41.496 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-09T04:40:41.505 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/overlay/ install 2023-06-09T04:40:41.507 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-09T04:40:41.516 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-09T04:40:41.791 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-09T04:40:41.800 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-06-09T04:40:42.078 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/perf/ install 2023-06-09T04:40:42.080 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-09T04:40:42.089 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-09T04:40:42.098 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-09T04:40:42.107 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-09T04:40:42.116 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/selftest/ install 2023-06-09T04:40:42.118 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-09T04:40:42.127 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-09T04:40:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-09T04:40:42.158 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-09T04:40:42.182 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/shared/ install 2023-06-09T04:40:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-09T04:40:42.192 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-09T04:40:42.206 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-09T04:40:42.215 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-09T04:40:42.230 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/tmpfs/ install 2023-06-09T04:40:42.231 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-09T04:40:42.240 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-09T04:40:42.249 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-09T04:40:42.258 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-09T04:40:42.267 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/udf/ install 2023-06-09T04:40:42.269 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-09T04:40:42.278 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-09T04:40:42.287 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-09T04:40:42.295 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-09T04:40:42.304 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dLknDlhvfJxfstests-dev/tests/xfs/ install 2023-06-09T04:40:42.308 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-09T04:40:42.317 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-09T04:40:44.244 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-09T04:40:44.253 INFO:teuthology.orchestra.run.smithi026.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-06-09T04:40:46.227 INFO:teuthology.orchestra.run.smithi026.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-09T04:40:46.236 INFO:teuthology.orchestra.run.smithi026.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-09T04:40:46.245 INFO:teuthology.orchestra.run.smithi026.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-09T04:40:46.254 INFO:teuthology.orchestra.run.smithi026.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-09T04:40:46.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:40:46.265 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec ls tests/generic) 2023-06-09T04:40:46.323 INFO:teuthology.orchestra.run.smithi026.stdout:001 2023-06-09T04:40:46.323 INFO:teuthology.orchestra.run.smithi026.stdout:001.out 2023-06-09T04:40:46.323 INFO:teuthology.orchestra.run.smithi026.stdout:002 2023-06-09T04:40:46.323 INFO:teuthology.orchestra.run.smithi026.stdout:002.out 2023-06-09T04:40:46.323 INFO:teuthology.orchestra.run.smithi026.stdout:003 2023-06-09T04:40:46.324 INFO:teuthology.orchestra.run.smithi026.stdout:003.out 2023-06-09T04:40:46.324 INFO:teuthology.orchestra.run.smithi026.stdout:004 2023-06-09T04:40:46.324 INFO:teuthology.orchestra.run.smithi026.stdout:004.out 2023-06-09T04:40:46.324 INFO:teuthology.orchestra.run.smithi026.stdout:005 2023-06-09T04:40:46.324 INFO:teuthology.orchestra.run.smithi026.stdout:005.out 2023-06-09T04:40:46.324 INFO:teuthology.orchestra.run.smithi026.stdout:006 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:006.out 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:007 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:007.out 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:008 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:008.out 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:009 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:009.out 2023-06-09T04:40:46.325 INFO:teuthology.orchestra.run.smithi026.stdout:010 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:010.out 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:011 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:011.out 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:012 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:012.out 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:013 2023-06-09T04:40:46.326 INFO:teuthology.orchestra.run.smithi026.stdout:013.out 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:014 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:014.out 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:015 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:015.out 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:016 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:016.out 2023-06-09T04:40:46.327 INFO:teuthology.orchestra.run.smithi026.stdout:017 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:017.out 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:018 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:018.out 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:019 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:019.out 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:020 2023-06-09T04:40:46.328 INFO:teuthology.orchestra.run.smithi026.stdout:020.out 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:021 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:021.out 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:022 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:022.out 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:023 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:023.out 2023-06-09T04:40:46.329 INFO:teuthology.orchestra.run.smithi026.stdout:024 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:024.out 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:025 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:025.out 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:026 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:026.out 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:027 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:027.out 2023-06-09T04:40:46.330 INFO:teuthology.orchestra.run.smithi026.stdout:028 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:028.out 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:029 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:029.out 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:030 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:030.out 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:031 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi026.stdout:031.out 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:032 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:032.out 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:033 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:033.out 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:034 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:034.out 2023-06-09T04:40:46.332 INFO:teuthology.orchestra.run.smithi026.stdout:035 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:035.cfg 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:035.out.default 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:035.out.nfs 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:036 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:036.out 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:037 2023-06-09T04:40:46.333 INFO:teuthology.orchestra.run.smithi026.stdout:037.out 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:038 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:038.out 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:039 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:039.out 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:040 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:040.out 2023-06-09T04:40:46.334 INFO:teuthology.orchestra.run.smithi026.stdout:041 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:041.out 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:042 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:042.out 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:043 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:043.out 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:044 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:044.out 2023-06-09T04:40:46.335 INFO:teuthology.orchestra.run.smithi026.stdout:045 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:045.out 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:046 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:046.out 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:047 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:047.out 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:048 2023-06-09T04:40:46.336 INFO:teuthology.orchestra.run.smithi026.stdout:048.out 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:049 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:049.out 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:050 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:050.cfg 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:050.out.default 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:050.out.nojournal 2023-06-09T04:40:46.337 INFO:teuthology.orchestra.run.smithi026.stdout:050.out.xfsquota 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:051 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:051.out 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:052 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:052.out 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:053 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:053.out 2023-06-09T04:40:46.338 INFO:teuthology.orchestra.run.smithi026.stdout:054 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:054.out 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:055 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:055.out 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:056 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:056.out 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:057 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:057.out 2023-06-09T04:40:46.339 INFO:teuthology.orchestra.run.smithi026.stdout:058 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:058.out 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:059 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:059.out 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:060 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:060.out 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:061 2023-06-09T04:40:46.340 INFO:teuthology.orchestra.run.smithi026.stdout:061.out 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:062 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:062.out 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:063 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:063.out 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:064 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:064.out 2023-06-09T04:40:46.341 INFO:teuthology.orchestra.run.smithi026.stdout:065 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:065.out 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:066 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:066.out 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:067 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:067.out 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:068 2023-06-09T04:40:46.342 INFO:teuthology.orchestra.run.smithi026.stdout:068.out 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:069 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:069.out 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:070 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:070.out 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:071 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:071.out 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:072 2023-06-09T04:40:46.343 INFO:teuthology.orchestra.run.smithi026.stdout:072.out 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:073 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:073.out 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:074 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:074.out 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:075 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:075.out 2023-06-09T04:40:46.344 INFO:teuthology.orchestra.run.smithi026.stdout:076 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:076.out 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:077 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:077.out 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:078 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:078.out 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:079 2023-06-09T04:40:46.345 INFO:teuthology.orchestra.run.smithi026.stdout:079.out 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:080 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:080.out 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:081 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:081.out 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:082 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:082.out 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:083 2023-06-09T04:40:46.346 INFO:teuthology.orchestra.run.smithi026.stdout:083.out 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:084 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:084.out 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:085 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:085.out 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:086 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:086.out 2023-06-09T04:40:46.347 INFO:teuthology.orchestra.run.smithi026.stdout:087 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:087.out 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:088 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:088.out 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:089 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:089.out 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:090 2023-06-09T04:40:46.348 INFO:teuthology.orchestra.run.smithi026.stdout:090.out 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:091 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:091.out 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:092 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:092.out 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:093 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:093.out 2023-06-09T04:40:46.349 INFO:teuthology.orchestra.run.smithi026.stdout:094 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:094.out 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:095 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:095.out 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:096 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:096.out 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:097 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:097.out 2023-06-09T04:40:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:098 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:098.out 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:099 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:099.out 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:100 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:100.out 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:101 2023-06-09T04:40:46.351 INFO:teuthology.orchestra.run.smithi026.stdout:101.out 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:102 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:102.out 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:103 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:103.out 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:104 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:104.out 2023-06-09T04:40:46.352 INFO:teuthology.orchestra.run.smithi026.stdout:105 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:105.out 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:106 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:106.out 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:107 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:107.out 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:108 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:108.out 2023-06-09T04:40:46.353 INFO:teuthology.orchestra.run.smithi026.stdout:109 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:109.out 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:110 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:110.out 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:111 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:111.out 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:112 2023-06-09T04:40:46.354 INFO:teuthology.orchestra.run.smithi026.stdout:112.out 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:113 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:113.out 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:114 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:114.out 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:115 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:115.out 2023-06-09T04:40:46.355 INFO:teuthology.orchestra.run.smithi026.stdout:116 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:116.out 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:117 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:117.out 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:118 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:118.out 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:119 2023-06-09T04:40:46.356 INFO:teuthology.orchestra.run.smithi026.stdout:119.out 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:120 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:120.out 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:121 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:121.out 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:122 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:122.out 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:123 2023-06-09T04:40:46.357 INFO:teuthology.orchestra.run.smithi026.stdout:123.out 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:124 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:124.out 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:125 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:125.out 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:126 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:126.out 2023-06-09T04:40:46.358 INFO:teuthology.orchestra.run.smithi026.stdout:127 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi026.stdout:127.out 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi026.stdout:128 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi026.stdout:128.out 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi026.stdout:129 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi026.stdout:129.out 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi026.stdout:130 2023-06-09T04:40:46.360 INFO:teuthology.orchestra.run.smithi026.stdout:130.out 2023-06-09T04:40:46.360 INFO:teuthology.orchestra.run.smithi026.stdout:131 2023-06-09T04:40:46.360 INFO:teuthology.orchestra.run.smithi026.stdout:131.out 2023-06-09T04:40:46.360 INFO:teuthology.orchestra.run.smithi026.stdout:132 2023-06-09T04:40:46.360 INFO:teuthology.orchestra.run.smithi026.stdout:132.out 2023-06-09T04:40:46.360 INFO:teuthology.orchestra.run.smithi026.stdout:133 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:133.out 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:134 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:134.out 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:135 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:135.out 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:136 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:136.out 2023-06-09T04:40:46.361 INFO:teuthology.orchestra.run.smithi026.stdout:137 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:137.out 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:138 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:138.out 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:139 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:139.out 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:140 2023-06-09T04:40:46.362 INFO:teuthology.orchestra.run.smithi026.stdout:140.out 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:141 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:141.out 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:142 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:142.out 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:143 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:143.out 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:144 2023-06-09T04:40:46.363 INFO:teuthology.orchestra.run.smithi026.stdout:144.out 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:145 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:145.out 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:146 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:146.out 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:147 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:147.out 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:148 2023-06-09T04:40:46.364 INFO:teuthology.orchestra.run.smithi026.stdout:148.out 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:149 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:149.out 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:150 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:150.out 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:151 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:151.out 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:152 2023-06-09T04:40:46.365 INFO:teuthology.orchestra.run.smithi026.stdout:152.out 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:153 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:153.out 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:154 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:154.out 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:155 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:155.out 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:156 2023-06-09T04:40:46.366 INFO:teuthology.orchestra.run.smithi026.stdout:156.out 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:157 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:157.out 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:158 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:158.out 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:159 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:159.out 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:160 2023-06-09T04:40:46.367 INFO:teuthology.orchestra.run.smithi026.stdout:160.out 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:161 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:161.out 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:162 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:162.out 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:163 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:163.out 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:164 2023-06-09T04:40:46.368 INFO:teuthology.orchestra.run.smithi026.stdout:164.out 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:165 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:165.out 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:166 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:166.out 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:167 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:167.out 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:168 2023-06-09T04:40:46.369 INFO:teuthology.orchestra.run.smithi026.stdout:168.out 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:169 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:169.out 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:170 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:170.out 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:171 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:171.out 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:172 2023-06-09T04:40:46.370 INFO:teuthology.orchestra.run.smithi026.stdout:172.out 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:173 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:173.out 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:174 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:174.out 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:175 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:175.out 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:176 2023-06-09T04:40:46.371 INFO:teuthology.orchestra.run.smithi026.stdout:176.out 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:177 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:177.out 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:178 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:178.out 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:179 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:179.out 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:180 2023-06-09T04:40:46.372 INFO:teuthology.orchestra.run.smithi026.stdout:180.out 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:181 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:181.out 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:182 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:182.out 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:183 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:183.out 2023-06-09T04:40:46.373 INFO:teuthology.orchestra.run.smithi026.stdout:184 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:184.out 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:185 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:185.out 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:186 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:186.out 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:187 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:187.out 2023-06-09T04:40:46.374 INFO:teuthology.orchestra.run.smithi026.stdout:188 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:188.out 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:189 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:189.out 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:190 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:190.out 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:191 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:191.out 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:192 2023-06-09T04:40:46.375 INFO:teuthology.orchestra.run.smithi026.stdout:192.out 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:193 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:193.out 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:194 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:194.out 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:195 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:195.out 2023-06-09T04:40:46.376 INFO:teuthology.orchestra.run.smithi026.stdout:196 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:196.out 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:197 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:197.out 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:198 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:198.out 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:199 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:199.out 2023-06-09T04:40:46.377 INFO:teuthology.orchestra.run.smithi026.stdout:200 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:200.out 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:201 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:201.out 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:202 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:202.out 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:203 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:203.out 2023-06-09T04:40:46.378 INFO:teuthology.orchestra.run.smithi026.stdout:204 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:204.out 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:205 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:205.out 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:206 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:206.out 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:207 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:207.out 2023-06-09T04:40:46.379 INFO:teuthology.orchestra.run.smithi026.stdout:208 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:208.out 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:209 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:209.out 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:210 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:210.out 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:211 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:211.out 2023-06-09T04:40:46.380 INFO:teuthology.orchestra.run.smithi026.stdout:212 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:212.out 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:213 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:213.out 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:214 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:214.out 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:215 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:215.out 2023-06-09T04:40:46.381 INFO:teuthology.orchestra.run.smithi026.stdout:216 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:216.out 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:217 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:217.out 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:218 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:218.out 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:219 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:219.out 2023-06-09T04:40:46.382 INFO:teuthology.orchestra.run.smithi026.stdout:220 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:220.out 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:221 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:221.out 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:222 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:222.out 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:223 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:223.out 2023-06-09T04:40:46.383 INFO:teuthology.orchestra.run.smithi026.stdout:224 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:224.out 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:225 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:225.out 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:226 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:226.out 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:227 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:227.out 2023-06-09T04:40:46.384 INFO:teuthology.orchestra.run.smithi026.stdout:228 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:228.out 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:229 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:229.out 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:230 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:230.out 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:231 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:231.out 2023-06-09T04:40:46.385 INFO:teuthology.orchestra.run.smithi026.stdout:232 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:232.out 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:233 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:233.out 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:234 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:234.out 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:235 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:235.out 2023-06-09T04:40:46.386 INFO:teuthology.orchestra.run.smithi026.stdout:236 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:236.out 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:237 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:237.out 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:238 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:238.out 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:239 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:239.out 2023-06-09T04:40:46.387 INFO:teuthology.orchestra.run.smithi026.stdout:240 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:240.out 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:241 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:241.out 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:242 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:242.out 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:243 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:243.out 2023-06-09T04:40:46.388 INFO:teuthology.orchestra.run.smithi026.stdout:244 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:244.out 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:245 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:245.out 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:246 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:246.out 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:247 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:247.out 2023-06-09T04:40:46.389 INFO:teuthology.orchestra.run.smithi026.stdout:248 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:248.out 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:249 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:249.out 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:250 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:250.out 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:251 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:251.out 2023-06-09T04:40:46.390 INFO:teuthology.orchestra.run.smithi026.stdout:252 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:252.out 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:253 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:253.out 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:254 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:254.out 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:255 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:255.out 2023-06-09T04:40:46.391 INFO:teuthology.orchestra.run.smithi026.stdout:256 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:256.out 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:257 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:257.out 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:258 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:258.out 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:259 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:259.out 2023-06-09T04:40:46.392 INFO:teuthology.orchestra.run.smithi026.stdout:260 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:260.out 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:261 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:261.out 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:262 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:262.out 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:263 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:263.out 2023-06-09T04:40:46.393 INFO:teuthology.orchestra.run.smithi026.stdout:264 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:264.out 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:265 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:265.out 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:266 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:266.out 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:267 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:267.out 2023-06-09T04:40:46.394 INFO:teuthology.orchestra.run.smithi026.stdout:268 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:268.out 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:269 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:269.out 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:270 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:270.out 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:271 2023-06-09T04:40:46.395 INFO:teuthology.orchestra.run.smithi026.stdout:271.out 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:272 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:272.out 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:273 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:273.out 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:274 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:274.out 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:275 2023-06-09T04:40:46.396 INFO:teuthology.orchestra.run.smithi026.stdout:275.out 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:276 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:276.out 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:277 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:277.out 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:278 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:278.out 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:279 2023-06-09T04:40:46.397 INFO:teuthology.orchestra.run.smithi026.stdout:279.out 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:280 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:280.out 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:281 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:281.out 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:282 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:282.out 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:283 2023-06-09T04:40:46.398 INFO:teuthology.orchestra.run.smithi026.stdout:283.out 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:284 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:284.out 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:285 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:285.out 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:286 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:286.out 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:287 2023-06-09T04:40:46.399 INFO:teuthology.orchestra.run.smithi026.stdout:287.out 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:288 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:288.out 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:289 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:289.out 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:290 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:290.out 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:291 2023-06-09T04:40:46.400 INFO:teuthology.orchestra.run.smithi026.stdout:291.out 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:292 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:292.out 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:293 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:293.out 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:294 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:294.out 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:295 2023-06-09T04:40:46.401 INFO:teuthology.orchestra.run.smithi026.stdout:295.out 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:296 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:296.out 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:297 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:297.out 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:298 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:298.out 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:299 2023-06-09T04:40:46.402 INFO:teuthology.orchestra.run.smithi026.stdout:299.out 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:300 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:300.out 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:301 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:301.out 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:302 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:302.out 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:303 2023-06-09T04:40:46.403 INFO:teuthology.orchestra.run.smithi026.stdout:303.out 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:304 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:304.out 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:305 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:305.out 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:306 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:306.out 2023-06-09T04:40:46.404 INFO:teuthology.orchestra.run.smithi026.stdout:307 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:307.out 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:308 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:308.out 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:309 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:309.out 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:310 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:310.out 2023-06-09T04:40:46.405 INFO:teuthology.orchestra.run.smithi026.stdout:311 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:311.out 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:312 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:312.out 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:313 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:313.out 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:314 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:314.out 2023-06-09T04:40:46.406 INFO:teuthology.orchestra.run.smithi026.stdout:315 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:315.out 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:316 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:316.out 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:317 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:317.out 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:318 2023-06-09T04:40:46.407 INFO:teuthology.orchestra.run.smithi026.stdout:318.out 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:319 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:319.out 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:320 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:320.out 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:321 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:321.out 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:322 2023-06-09T04:40:46.408 INFO:teuthology.orchestra.run.smithi026.stdout:322.out 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:323 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:323.out 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:324 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:324.out 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:325 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:325.out 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:326 2023-06-09T04:40:46.409 INFO:teuthology.orchestra.run.smithi026.stdout:326.out 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:327 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:327.out 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:328 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:328.out 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:329 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:329.out 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:330 2023-06-09T04:40:46.410 INFO:teuthology.orchestra.run.smithi026.stdout:330.out 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:331 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:331.out 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:332 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:332.out 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:333 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:333.out 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:334 2023-06-09T04:40:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:334.out 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:335 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:335.out 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:336 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:336.out 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:337 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:337.out 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:338 2023-06-09T04:40:46.412 INFO:teuthology.orchestra.run.smithi026.stdout:338.out 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:339 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:339.out 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:340 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:340.out 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:341 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:341.out 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:342 2023-06-09T04:40:46.413 INFO:teuthology.orchestra.run.smithi026.stdout:342.out 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:343 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:343.out 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:344 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:344.out 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:345 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:345.out 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:346 2023-06-09T04:40:46.414 INFO:teuthology.orchestra.run.smithi026.stdout:346.out 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:347 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:347.out 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:348 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:348.out 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:349 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:349.out 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:350 2023-06-09T04:40:46.415 INFO:teuthology.orchestra.run.smithi026.stdout:350.out 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:351 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:351.out 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:352 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:352.out 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:353 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:353.out 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:354 2023-06-09T04:40:46.416 INFO:teuthology.orchestra.run.smithi026.stdout:354.out 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:355 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:355.out 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:356 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:356.out 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:357 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:357.out 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:358 2023-06-09T04:40:46.417 INFO:teuthology.orchestra.run.smithi026.stdout:358.out 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:359 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:359.out 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:360 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:360.out 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:361 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:361.out 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:362 2023-06-09T04:40:46.418 INFO:teuthology.orchestra.run.smithi026.stdout:362.out 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:363 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:363.out 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:364 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:364.out 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:365 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:365.out 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:366 2023-06-09T04:40:46.419 INFO:teuthology.orchestra.run.smithi026.stdout:366.out 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:367 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:367.out 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:368 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:368.out 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:369 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:369.out 2023-06-09T04:40:46.420 INFO:teuthology.orchestra.run.smithi026.stdout:370 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:370.out 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:371 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:371.out 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:372 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:372.out 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:373 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:373.out 2023-06-09T04:40:46.421 INFO:teuthology.orchestra.run.smithi026.stdout:374 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:374.out 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:375 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:375.out 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:376 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:376.out 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:377 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:377.out 2023-06-09T04:40:46.422 INFO:teuthology.orchestra.run.smithi026.stdout:378 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:378.out 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:379 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:379.out 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:380 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:380.out 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:381 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:381.out 2023-06-09T04:40:46.423 INFO:teuthology.orchestra.run.smithi026.stdout:382 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:382.out 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:383 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:383.out 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:384 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:384.out 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:385 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:385.out 2023-06-09T04:40:46.424 INFO:teuthology.orchestra.run.smithi026.stdout:386 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:386.out 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:387 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:387.out 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:388 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:388.out 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:389 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:389.out 2023-06-09T04:40:46.425 INFO:teuthology.orchestra.run.smithi026.stdout:390 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:390.out 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:391 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:391.out 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:392 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:392.out 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:393 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:393.out 2023-06-09T04:40:46.426 INFO:teuthology.orchestra.run.smithi026.stdout:394 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:394.out 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:395 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:395.out 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:396 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:396.out 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:397 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:397.out 2023-06-09T04:40:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:398 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:398.out 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:399 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:399.out 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:400 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:400.out 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:401 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:401.out 2023-06-09T04:40:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:402 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:402.out 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:403 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:403.out 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:404 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:404.out 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:405 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:405.out 2023-06-09T04:40:46.429 INFO:teuthology.orchestra.run.smithi026.stdout:406 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:406.out 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:407 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:407.out 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:408 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:408.out 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:409 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:409.out 2023-06-09T04:40:46.430 INFO:teuthology.orchestra.run.smithi026.stdout:410 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:410.out 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:411 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:411.out 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:412 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:412.out 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:413 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:413.out 2023-06-09T04:40:46.431 INFO:teuthology.orchestra.run.smithi026.stdout:414 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:414.out 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:415 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:415.out 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:416 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:416.out 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:417 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:417.out 2023-06-09T04:40:46.432 INFO:teuthology.orchestra.run.smithi026.stdout:418 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:418.out 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:419 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:419.out 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:420 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:420.out 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:421 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:421.out 2023-06-09T04:40:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:422 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:422.out 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:423 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:423.out 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:424 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:424.out 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:425 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:425.out 2023-06-09T04:40:46.434 INFO:teuthology.orchestra.run.smithi026.stdout:426 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:426.out 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:427 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:427.out 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:428 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:428.out 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:429 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:429.out 2023-06-09T04:40:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:430 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:430.out 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:431 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:431.out 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:432 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:432.out 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:433 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:433.out 2023-06-09T04:40:46.436 INFO:teuthology.orchestra.run.smithi026.stdout:434 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:434.out 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:435 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:435.out 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:436 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:436.out 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:437 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:437.out 2023-06-09T04:40:46.437 INFO:teuthology.orchestra.run.smithi026.stdout:438 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:438.out 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:439 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:439.out 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:440 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:440.out 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:441 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:441.out 2023-06-09T04:40:46.438 INFO:teuthology.orchestra.run.smithi026.stdout:442 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:442.out 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:443 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:443.out 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:444 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:444.out 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:445 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:445.out 2023-06-09T04:40:46.439 INFO:teuthology.orchestra.run.smithi026.stdout:446 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:446.out 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:447 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:447.out 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:448 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:448.out 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:449 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:449.out 2023-06-09T04:40:46.440 INFO:teuthology.orchestra.run.smithi026.stdout:450 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:450.out 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:451 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:451.out 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:452 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:452.out 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:453 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:453.out 2023-06-09T04:40:46.441 INFO:teuthology.orchestra.run.smithi026.stdout:454 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:454.out 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:455 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:455.out 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:456 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:456.out 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:457 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:457.out 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi026.stdout:458 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:458.out 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:459 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:459.out 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:460 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:460.out 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:461 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:461.out 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi026.stdout:462 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:462.out 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:463 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:463.out 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:464 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:464.out 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:465 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:465.out 2023-06-09T04:40:46.444 INFO:teuthology.orchestra.run.smithi026.stdout:466 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:466.out 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:467 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:467.out 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:468 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:468.out 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:469 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:469.out 2023-06-09T04:40:46.445 INFO:teuthology.orchestra.run.smithi026.stdout:470 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:470.out 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:471 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:471.out 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:472 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:472.out 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:473 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:473.out 2023-06-09T04:40:46.446 INFO:teuthology.orchestra.run.smithi026.stdout:474 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:474.out 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:475 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:475.out 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:476 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:476.out 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:477 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:477.out 2023-06-09T04:40:46.447 INFO:teuthology.orchestra.run.smithi026.stdout:478 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:478.out 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:479 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:479.out 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:480 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:480.out 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:481 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:481.out 2023-06-09T04:40:46.448 INFO:teuthology.orchestra.run.smithi026.stdout:482 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:482.out 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:483 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:483.out 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:484 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:484.out 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:485 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:485.out 2023-06-09T04:40:46.449 INFO:teuthology.orchestra.run.smithi026.stdout:486 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:486.out 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:487 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:487.out 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:488 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:488.out 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:489 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:489.out 2023-06-09T04:40:46.450 INFO:teuthology.orchestra.run.smithi026.stdout:490 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:490.out 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:491 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:491.out 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:492 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:492.out 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:493 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:493.out 2023-06-09T04:40:46.451 INFO:teuthology.orchestra.run.smithi026.stdout:494 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:494.out 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:495 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:495.out 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:496 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:496.out 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:497 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:497.out 2023-06-09T04:40:46.452 INFO:teuthology.orchestra.run.smithi026.stdout:498 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:498.out 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:499 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:499.out 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:500 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:500.out 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:501 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:501.out 2023-06-09T04:40:46.453 INFO:teuthology.orchestra.run.smithi026.stdout:502 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:502.out 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:503 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:503.out 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:504 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:504.out 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:505 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:505.out 2023-06-09T04:40:46.454 INFO:teuthology.orchestra.run.smithi026.stdout:506 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:506.out 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:507 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:507.out 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:508 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:508.out 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:509 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:509.out 2023-06-09T04:40:46.455 INFO:teuthology.orchestra.run.smithi026.stdout:510 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:510.out 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:511 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:511.out 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:512 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:512.out 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:513 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:513.out 2023-06-09T04:40:46.456 INFO:teuthology.orchestra.run.smithi026.stdout:514 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:514.out 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:515 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:515.out 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:516 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:516.out 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:517 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:517.out 2023-06-09T04:40:46.457 INFO:teuthology.orchestra.run.smithi026.stdout:518 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:518.out 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:519 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:519.out 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:520 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:520.out 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:521 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:521.out 2023-06-09T04:40:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:522 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:522.out 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:523 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:523.out 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:524 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:524.out 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:525 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:525.out 2023-06-09T04:40:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:526 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:526.out 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:527 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:527.out 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:528 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:528.out 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:529 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:529.out 2023-06-09T04:40:46.460 INFO:teuthology.orchestra.run.smithi026.stdout:530 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:530.out 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:531 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:531.out 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:532 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:532.out 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:533 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:533.out 2023-06-09T04:40:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:534 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:534.out 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:535 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:535.out 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:536 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:536.out 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:537 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:537.out 2023-06-09T04:40:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:538 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:538.out 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:539 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:539.out 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:540 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:540.out 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:541 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:541.out 2023-06-09T04:40:46.463 INFO:teuthology.orchestra.run.smithi026.stdout:542 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:542.out 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:543 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:543.out 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:544 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:544.out 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:545 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:545.out 2023-06-09T04:40:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:546 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:546.out 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:547 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:547.out 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:548 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:548.out 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:549 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:549.out 2023-06-09T04:40:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:550 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:550.out 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:551 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:551.out 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:552 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:552.out 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:553 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:553.out 2023-06-09T04:40:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:554 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:554.out 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:555 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:555.out 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:556 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:556.out 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:557 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:557.out 2023-06-09T04:40:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:558 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:558.out 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:559 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:559.out 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:560 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:560.out 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:561 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:561.out 2023-06-09T04:40:46.468 INFO:teuthology.orchestra.run.smithi026.stdout:562 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:562.out 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:563 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:563.out 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:564 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:564.out 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:565 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:565.out 2023-06-09T04:40:46.469 INFO:teuthology.orchestra.run.smithi026.stdout:566 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:566.out 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:567 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:567.out 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:568 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:568.out 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:569 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:569.out 2023-06-09T04:40:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:570 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:570.out 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:571 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:571.out 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:572 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:572.out 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:573 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:573.out 2023-06-09T04:40:46.471 INFO:teuthology.orchestra.run.smithi026.stdout:574 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:574.out 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:575 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:575.out 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:576 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:576.out 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:577 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:577.out 2023-06-09T04:40:46.472 INFO:teuthology.orchestra.run.smithi026.stdout:578 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:578.out 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:579 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:579.out 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:580 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:580.out 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:581 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:581.out 2023-06-09T04:40:46.473 INFO:teuthology.orchestra.run.smithi026.stdout:582 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:582.out 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:583 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:583.out 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:584 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:584.out 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:585 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:585.out 2023-06-09T04:40:46.474 INFO:teuthology.orchestra.run.smithi026.stdout:586 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:586.out 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:587 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:587.out 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:588 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:588.out 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:589 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:589.out 2023-06-09T04:40:46.475 INFO:teuthology.orchestra.run.smithi026.stdout:590 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:590.out 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:591 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:591.out 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:592 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:592.out 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:593 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:593.out 2023-06-09T04:40:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:594 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:594.out 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:595 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:595.out 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:596 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:596.out 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:597 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:597.out 2023-06-09T04:40:46.477 INFO:teuthology.orchestra.run.smithi026.stdout:598 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:598.out 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:599 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:599.out 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:600 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:600.out 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:601 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:601.out 2023-06-09T04:40:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:602 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:602.out 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:603 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:603.out 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:604 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:604.out 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:605 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:605.out 2023-06-09T04:40:46.479 INFO:teuthology.orchestra.run.smithi026.stdout:606 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:606.out 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:607 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:607.out 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:608 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:608.out 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:609 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:609.out 2023-06-09T04:40:46.480 INFO:teuthology.orchestra.run.smithi026.stdout:610 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:610.out 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:611 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:611.out 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:612 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:612.out 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:613 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:613.out 2023-06-09T04:40:46.481 INFO:teuthology.orchestra.run.smithi026.stdout:614 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:614.out 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:615 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:615.out 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:616 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:616.out 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:617 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:617.out 2023-06-09T04:40:46.482 INFO:teuthology.orchestra.run.smithi026.stdout:618 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:618.out 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:619 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:619.out 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:620 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:620.out 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:621 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:621.out 2023-06-09T04:40:46.483 INFO:teuthology.orchestra.run.smithi026.stdout:622 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:622.out 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:623 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:623.out 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:624 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:624.out 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:625 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:625.out 2023-06-09T04:40:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:626 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:626.out 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:627 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:627.out 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:628 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:628.out 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:629 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:629.out 2023-06-09T04:40:46.485 INFO:teuthology.orchestra.run.smithi026.stdout:630 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:630.out 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:631 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:631.out 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:632 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:632.out 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:633 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:633.out 2023-06-09T04:40:46.486 INFO:teuthology.orchestra.run.smithi026.stdout:634 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:634.out 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:635 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:635.out 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:636 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:636.out 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:637 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:637.out 2023-06-09T04:40:46.487 INFO:teuthology.orchestra.run.smithi026.stdout:638 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:638.out 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:639 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:639.out 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:640 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:640.out 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:641 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:641.out 2023-06-09T04:40:46.488 INFO:teuthology.orchestra.run.smithi026.stdout:642 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:642.out 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:643 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:643.out 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:644 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:644.out 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:645 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:645.out 2023-06-09T04:40:46.489 INFO:teuthology.orchestra.run.smithi026.stdout:646 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:646.out 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:647 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:647.out 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:648 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:648.out 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:649 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:649.out 2023-06-09T04:40:46.490 INFO:teuthology.orchestra.run.smithi026.stdout:650 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:650.out 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:651 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:651.out 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:652 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:652.out 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:653 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:653.out 2023-06-09T04:40:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:654 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:654.out 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:655 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:655.out 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:656 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:656.out 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:657 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:657.out 2023-06-09T04:40:46.492 INFO:teuthology.orchestra.run.smithi026.stdout:658 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:658.out 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:659 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:659.out 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:660 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:660.out 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:661 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:661.out 2023-06-09T04:40:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:662 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:662.out 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:663 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:663.out 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:664 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:664.out 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:665 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:665.out 2023-06-09T04:40:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:666 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:666.out 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:667 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:667.out 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:668 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:668.out 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:669 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:669.out 2023-06-09T04:40:46.495 INFO:teuthology.orchestra.run.smithi026.stdout:670 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:670.out 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:671 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:671.out 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:672 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:672.out 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:673 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:673.out 2023-06-09T04:40:46.496 INFO:teuthology.orchestra.run.smithi026.stdout:674 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:674.out 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:675 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:675.out 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:676 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:676.out 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:677 2023-06-09T04:40:46.497 INFO:teuthology.orchestra.run.smithi026.stdout:677.out 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:678 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:678.out 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:679 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:679.out 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:680 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:680.out 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:681 2023-06-09T04:40:46.498 INFO:teuthology.orchestra.run.smithi026.stdout:681.out 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:682 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:682.out 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:683 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:683.out 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:684 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:684.out 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:685 2023-06-09T04:40:46.499 INFO:teuthology.orchestra.run.smithi026.stdout:685.out 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:686 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:686.out 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:687 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:687.out 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:688 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:688.out 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:689 2023-06-09T04:40:46.500 INFO:teuthology.orchestra.run.smithi026.stdout:689.out 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:690 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:690.out 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:691 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:691.out 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:692 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:692.out 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:693 2023-06-09T04:40:46.501 INFO:teuthology.orchestra.run.smithi026.stdout:693.out 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:694 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:694.out 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:695 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:695.out 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:696 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:696.out 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:697 2023-06-09T04:40:46.502 INFO:teuthology.orchestra.run.smithi026.stdout:697.out 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:698 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:698.out 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:699 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:699.out 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:700 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:700.out 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:701 2023-06-09T04:40:46.503 INFO:teuthology.orchestra.run.smithi026.stdout:701.out 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:702 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:702.out 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:703 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:703.out 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:704 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:704.out 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:705 2023-06-09T04:40:46.504 INFO:teuthology.orchestra.run.smithi026.stdout:705.out 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:706 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:706.out 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:707 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:707.out 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:708 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:708.out 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:709 2023-06-09T04:40:46.505 INFO:teuthology.orchestra.run.smithi026.stdout:709.out 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:710 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:710.out 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:711 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:711.out 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:712 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:712.out 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:713 2023-06-09T04:40:46.506 INFO:teuthology.orchestra.run.smithi026.stdout:713.out 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:714 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:714.out 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:715 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:715.out 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:716 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:716.out 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:717 2023-06-09T04:40:46.507 INFO:teuthology.orchestra.run.smithi026.stdout:717.out 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:718 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:718.out 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:719 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:719.out 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:720 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:720.out 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:721 2023-06-09T04:40:46.508 INFO:teuthology.orchestra.run.smithi026.stdout:721.out 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:722 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:722.out 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:723 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:723.out 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:724 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:724.out 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:725 2023-06-09T04:40:46.509 INFO:teuthology.orchestra.run.smithi026.stdout:725.out 2023-06-09T04:40:46.510 INFO:teuthology.orchestra.run.smithi026.stdout:726 2023-06-09T04:40:46.510 INFO:teuthology.orchestra.run.smithi026.stdout:726.out 2023-06-09T04:40:46.510 INFO:teuthology.orchestra.run.smithi026.stdout:727 2023-06-09T04:40:46.510 INFO:teuthology.orchestra.run.smithi026.stdout:727.out 2023-06-09T04:40:46.510 INFO:teuthology.orchestra.run.smithi026.stdout:group.list 2023-06-09T04:40:46.510 INFO:teuthology.orchestra.run.smithi026.stdout:Makefile 2023-06-09T04:40:46.511 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-09T04:40:46.669 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:40:46.673 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:40:46.673 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:48.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:48.070 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:48.688 INFO:teuthology.orchestra.run.smithi026.stdout:generic/001 2s 2023-06-09T04:40:48.693 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/001 2023-06-09T04:40:48.693 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:40:48.695 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:48.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[146319]: fuse finished with error 0 and tester_r 0 2023-06-09T04:40:48.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:40:48.728 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-09T04:40:48.900 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:40:48.904 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:40:48.905 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:49.353 INFO:teuthology.orchestra.run.smithi026.stdout:generic/002 1s 2023-06-09T04:40:49.358 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/002 2023-06-09T04:40:49.358 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:40:49.360 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:49.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:40:49.384 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-09T04:40:49.597 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:40:49.602 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:40:49.602 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:49.737 INFO:teuthology.orchestra.run.smithi026.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:40:49.740 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/003 2023-06-09T04:40:49.741 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/003 2023-06-09T04:40:49.741 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:40:49.743 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:49.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:40:49.760 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-09T04:40:49.931 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:40:49.935 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:40:49.935 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:50.077 INFO:teuthology.orchestra.run.smithi026.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-09T04:40:50.081 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/004 2023-06-09T04:40:50.081 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/004 2023-06-09T04:40:50.081 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:40:50.083 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:50.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:40:50.106 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:50.826 INFO:teuthology.orchestra.run.smithi026.stdout:generic/005 0s 2023-06-09T04:40:50.831 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/005 2023-06-09T04:40:50.831 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:40:50.833 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:40:50.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:40:50.859 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-09T04:40:51.054 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:40:51.058 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:40:51.058 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:41:18.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:18.140 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:27.321 INFO:teuthology.orchestra.run.smithi026.stdout:generic/006 36s 2023-06-09T04:41:27.465 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/006 2023-06-09T04:41:27.465 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:41:27.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:41:27.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:27.494 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-09T04:41:27.708 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:27.712 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:27.713 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:41:48.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:48.444 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:18.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:18.528 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:45.358 INFO:teuthology.orchestra.run.smithi026.stdout:generic/007 78s 2023-06-09T04:42:45.362 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/007 2023-06-09T04:42:45.363 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:42:45.364 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:45.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:42:45.385 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-09T04:42:45.595 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:42:45.599 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:42:45.599 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:46.663 INFO:teuthology.orchestra.run.smithi026.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:42:46.666 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/008 2023-06-09T04:42:46.667 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/008 2023-06-09T04:42:46.667 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:42:46.669 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:46.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:42:46.690 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-09T04:42:46.862 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:42:46.866 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:42:46.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:47.775 INFO:teuthology.orchestra.run.smithi026.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:42:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/009 2023-06-09T04:42:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/009 2023-06-09T04:42:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:42:47.781 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:47.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:42:47.804 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-09T04:42:47.975 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:42:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:42:47.979 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:48.114 INFO:teuthology.orchestra.run.smithi026.stdout:generic/010 [not run] /tmp/tmp.dLknDlhvfJxfstests-dev/src/dbtest not built 2023-06-09T04:42:48.118 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/010 2023-06-09T04:42:48.118 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/010 2023-06-09T04:42:48.118 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:42:48.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:48.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:42:48.135 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-09T04:42:48.307 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:42:48.311 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:42:48.311 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:42:48.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:48.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:19.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:19.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:30.684 INFO:teuthology.orchestra.run.smithi026.stdout:generic/011 42s 2023-06-09T04:43:30.747 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/011 2023-06-09T04:43:30.747 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:43:30.749 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:43:30.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:30.782 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-09T04:43:30.990 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:43:30.994 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:30.995 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:43:32.046 INFO:teuthology.orchestra.run.smithi026.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:43:32.050 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/012 2023-06-09T04:43:32.050 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/012 2023-06-09T04:43:32.050 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:43:32.052 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:43:32.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:32.079 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-09T04:43:32.285 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:43:32.289 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:32.289 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:43:49.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:49.506 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:19.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:19.912 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:50.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:50.270 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:14.800 INFO:teuthology.orchestra.run.smithi026.stdout:generic/013 102s 2023-06-09T04:45:14.866 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/013 2023-06-09T04:45:14.867 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:45:14.870 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:45:14.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:45:14.881 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-09T04:45:15.124 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:45:15.134 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:45:15.134 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:45:20.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:20.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:20.908 INFO:tasks.ceph.mds.c.smithi026.stderr:2023-06-09T04:45:20.905+0000 7f9280cc5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 192648) UID: 0 2023-06-09T04:45:20.911 INFO:tasks.ceph.mds.a.smithi026.stderr:2023-06-09T04:45:20.904+0000 7f639aa73700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 192648) UID: 0 2023-06-09T04:48:36.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:36.788 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:06.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:06.880 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:36.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:36.991 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:57.971 INFO:teuthology.orchestra.run.smithi026.stdout:generic/014 282s 2023-06-09T04:49:57.978 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/014 2023-06-09T04:49:57.979 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:49:57.981 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:49:58.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:58.004 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-09T04:49:58.368 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:49:58.374 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:58.375 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:49:58.621 INFO:teuthology.orchestra.run.smithi026.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:49:58.625 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/015 2023-06-09T04:49:58.625 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/015 2023-06-09T04:49:58.625 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:49:58.627 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:49:58.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:58.654 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-09T04:49:58.965 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:49:58.975 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:58.975 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:00.835 INFO:teuthology.orchestra.run.smithi026.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:50:00.841 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/016 2023-06-09T04:50:00.841 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/016 2023-06-09T04:50:00.842 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:50:00.845 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:00.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:00.865 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-09T04:50:01.453 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:01.459 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:01.669 INFO:teuthology.orchestra.run.smithi026.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:50:01.676 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/017 2023-06-09T04:50:01.676 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/017 2023-06-09T04:50:01.676 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:50:01.679 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:01.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:01.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-09T04:50:02.008 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:02.019 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:02.230 INFO:teuthology.orchestra.run.smithi026.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:50:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/018 2023-06-09T04:50:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/018 2023-06-09T04:50:02.234 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:50:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:02.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:02.266 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-09T04:50:02.571 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:02.583 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:02.797 INFO:teuthology.orchestra.run.smithi026.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:50:02.805 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/019 2023-06-09T04:50:02.806 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/019 2023-06-09T04:50:02.806 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:50:02.815 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:02.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:02.839 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-09T04:50:03.134 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:03.143 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:03.143 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:07.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:07.083 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:19.226 INFO:teuthology.orchestra.run.smithi026.stdout:generic/020 - output mismatch (see /tmp/tmp.dLknDlhvfJxfstests-dev/results//generic/020.out.bad) 2023-06-09T04:50:19.229 INFO:teuthology.orchestra.run.smithi026.stdout: --- tests/generic/020.out 2023-06-09 04:39:30.162303800 +0000 2023-06-09T04:50:19.230 INFO:teuthology.orchestra.run.smithi026.stdout: +++ /tmp/tmp.dLknDlhvfJxfstests-dev/results//generic/020.out.bad 2023-06-09 04:50:19.223841193 +0000 2023-06-09T04:50:19.230 INFO:teuthology.orchestra.run.smithi026.stdout: @@ -39,27 +39,6 @@ 2023-06-09T04:50:19.230 INFO:teuthology.orchestra.run.smithi026.stdout: user.snrub="fish2\012" 2023-06-09T04:50:19.230 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:19.230 INFO:teuthology.orchestra.run.smithi026.stdout: *** add lots of attributes 2023-06-09T04:50:19.230 INFO:teuthology.orchestra.run.smithi026.stdout: -*** check 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: - *** MAX_ATTRS attribute(s) 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: -*** remove lots of attributes 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: - *** print attributes 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: -# file: 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: -user.snrub="fish2\012" 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: - 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: -*** really long value 2023-06-09T04:50:19.231 INFO:teuthology.orchestra.run.smithi026.stdout: -0000000 00 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -* 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -ATTRSIZE 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -*** set/get/remove really long names (expect failure) 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -attr_set: Invalid argument 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -attr_get: Invalid argument 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-06-09T04:50:19.232 INFO:teuthology.orchestra.run.smithi026.stdout: -attr_remove: Invalid argument 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: -*** check final 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: - *** print attributes 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: -# file: 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: -user.snrub="fish2\012" 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: - 2023-06-09T04:50:19.233 INFO:teuthology.orchestra.run.smithi026.stdout: -*** delete 2023-06-09T04:50:19.234 INFO:teuthology.orchestra.run.smithi026.stdout: +attr_set: No space left on device 2023-06-09T04:50:19.234 INFO:teuthology.orchestra.run.smithi026.stdout: +Could not set "attribute_2335" for /tmp/tmp.QgJpq9IdBDtest/attribute_195353 2023-06-09T04:50:19.234 INFO:teuthology.orchestra.run.smithi026.stdout: +!!! failed to add "attribute_2335" 2023-06-09T04:50:19.234 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/020 2023-06-09T04:50:19.235 INFO:teuthology.orchestra.run.smithi026.stdout:Failures: generic/020 2023-06-09T04:50:19.235 INFO:teuthology.orchestra.run.smithi026.stdout:Failed 1 of 1 tests 2023-06-09T04:50:19.235 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:19.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:50:19.252 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-06-09T04:50:19.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-06-09T04:50:19.252 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-09T04:50:19.842 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:19.852 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:19.852 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:21.826 INFO:teuthology.orchestra.run.smithi026.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:50:21.830 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/021 2023-06-09T04:50:21.831 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/021 2023-06-09T04:50:21.831 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:50:21.833 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:21.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:21.856 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-09T04:50:22.479 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:22.491 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:22.491 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:24.369 INFO:teuthology.orchestra.run.smithi026.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:50:24.378 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/022 2023-06-09T04:50:24.378 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/022 2023-06-09T04:50:24.378 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:50:24.383 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:24.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:24.403 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-09T04:50:25.007 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:50:25.011 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:25.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:50:37.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:37.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:07.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:07.255 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:37.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:37.711 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:43.564 INFO:teuthology.orchestra.run.smithi026.stdout:generic/023 78s 2023-06-09T04:51:43.570 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/023 2023-06-09T04:51:43.570 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:43.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:43.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:43.594 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-09T04:51:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:44.071 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:44.071 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:44.224 INFO:teuthology.orchestra.run.smithi026.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:51:44.227 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/024 2023-06-09T04:51:44.228 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/024 2023-06-09T04:51:44.228 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:44.230 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:44.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:44.274 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-09T04:51:44.721 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:44.725 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:44.725 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:44.883 INFO:teuthology.orchestra.run.smithi026.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:51:44.886 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/025 2023-06-09T04:51:44.886 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/025 2023-06-09T04:51:44.887 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:44.888 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:44.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:44.941 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-09T04:51:45.392 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:45.396 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:45.397 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:45.565 INFO:teuthology.orchestra.run.smithi026.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-06-09T04:51:45.568 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/026 2023-06-09T04:51:45.569 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/026 2023-06-09T04:51:45.569 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:45.571 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:45.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:45.591 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-09T04:51:45.763 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:45.768 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:45.768 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:45.902 INFO:teuthology.orchestra.run.smithi026.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:45.905 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/027 2023-06-09T04:51:45.905 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/027 2023-06-09T04:51:45.906 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:45.907 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:45.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:45.936 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-09T04:51:46.107 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:46.112 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:46.112 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:51.262 INFO:teuthology.orchestra.run.smithi026.stdout:generic/028 5s 2023-06-09T04:51:51.267 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/028 2023-06-09T04:51:51.267 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:51.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:51.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:51.290 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-09T04:51:51.462 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:51.467 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:51.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:51.598 INFO:teuthology.orchestra.run.smithi026.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:51.601 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/029 2023-06-09T04:51:51.601 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/029 2023-06-09T04:51:51.601 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:51.603 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:51.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:51.630 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-09T04:51:51.800 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:51.804 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:51.804 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:51.935 INFO:teuthology.orchestra.run.smithi026.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:51.939 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/030 2023-06-09T04:51:51.939 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/030 2023-06-09T04:51:51.939 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:51.941 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:51.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:51.961 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-09T04:51:52.132 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:52.137 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:52.137 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:52.268 INFO:teuthology.orchestra.run.smithi026.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:52.271 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/031 2023-06-09T04:51:52.272 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/031 2023-06-09T04:51:52.272 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:52.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:52.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:52.297 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-09T04:51:52.470 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:52.475 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:52.475 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:52.607 INFO:teuthology.orchestra.run.smithi026.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:52.610 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/032 2023-06-09T04:51:52.611 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/032 2023-06-09T04:51:52.611 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:52.613 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:52.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:52.632 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-09T04:51:52.803 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:52.808 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:52.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:52.936 INFO:teuthology.orchestra.run.smithi026.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:52.940 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/033 2023-06-09T04:51:52.940 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/033 2023-06-09T04:51:52.940 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:52.942 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:52.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:52.957 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-09T04:51:53.126 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:53.131 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:53.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:53.277 INFO:teuthology.orchestra.run.smithi026.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:51:53.281 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/034 2023-06-09T04:51:53.281 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/034 2023-06-09T04:51:53.281 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:53.283 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:53.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:53.310 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-09T04:51:53.485 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:53.489 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:53.489 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:53.681 INFO:teuthology.orchestra.run.smithi026.stdout:generic/035 0s 2023-06-09T04:51:53.685 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/035 2023-06-09T04:51:53.685 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:51:53.687 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:51:53.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:53.712 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-09T04:51:54.180 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:51:54.184 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:54.184 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:04.434 INFO:teuthology.orchestra.run.smithi026.stdout:generic/036 10s 2023-06-09T04:52:04.438 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/036 2023-06-09T04:52:04.438 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:04.440 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:04.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:04.455 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-09T04:52:04.926 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:04.930 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:04.931 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:05.062 INFO:teuthology.orchestra.run.smithi026.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:05.066 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/037 2023-06-09T04:52:05.066 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/037 2023-06-09T04:52:05.066 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:05.068 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:05.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:05.087 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-09T04:52:05.257 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:05.261 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:05.262 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:05.393 INFO:teuthology.orchestra.run.smithi026.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/038 2023-06-09T04:52:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/038 2023-06-09T04:52:05.397 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:05.399 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:05.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:05.420 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-09T04:52:05.592 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:05.596 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:05.596 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:05.740 INFO:teuthology.orchestra.run.smithi026.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:05.743 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/039 2023-06-09T04:52:05.744 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/039 2023-06-09T04:52:05.744 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:05.746 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:05.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:05.764 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-09T04:52:05.936 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:05.941 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:05.941 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:06.085 INFO:teuthology.orchestra.run.smithi026.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:06.089 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/040 2023-06-09T04:52:06.089 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/040 2023-06-09T04:52:06.089 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:06.091 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:06.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:06.118 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-09T04:52:06.289 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:06.294 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:06.294 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:06.439 INFO:teuthology.orchestra.run.smithi026.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:06.442 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/041 2023-06-09T04:52:06.443 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/041 2023-06-09T04:52:06.443 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:06.445 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:06.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:06.460 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-09T04:52:06.632 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:06.636 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:06.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:06.768 INFO:teuthology.orchestra.run.smithi026.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:06.772 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/042 2023-06-09T04:52:06.772 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/042 2023-06-09T04:52:06.772 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:06.774 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:06.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:06.792 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-09T04:52:06.962 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:06.967 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:06.967 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:07.098 INFO:teuthology.orchestra.run.smithi026.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:07.101 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/043 2023-06-09T04:52:07.101 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/043 2023-06-09T04:52:07.101 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:07.103 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:07.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:07.123 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-09T04:52:07.296 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:07.300 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:07.300 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:07.433 INFO:teuthology.orchestra.run.smithi026.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:07.436 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/044 2023-06-09T04:52:07.436 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/044 2023-06-09T04:52:07.437 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:07.439 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:07.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:07.457 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-09T04:52:07.627 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:07.632 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:07.632 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:07.761 INFO:teuthology.orchestra.run.smithi026.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:07.764 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/045 2023-06-09T04:52:07.765 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/045 2023-06-09T04:52:07.765 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:07.767 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:07.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:07.783 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:07.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:07.785 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-09T04:52:07.999 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:08.003 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:08.004 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:08.135 INFO:teuthology.orchestra.run.smithi026.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:08.138 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/046 2023-06-09T04:52:08.138 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/046 2023-06-09T04:52:08.139 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:08.140 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:08.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:08.167 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-09T04:52:08.338 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:08.342 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:08.343 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:08.478 INFO:teuthology.orchestra.run.smithi026.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/047 2023-06-09T04:52:08.481 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/047 2023-06-09T04:52:08.482 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:08.483 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:08.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:08.500 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-09T04:52:08.671 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:08.676 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:08.676 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:08.806 INFO:teuthology.orchestra.run.smithi026.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:08.810 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/048 2023-06-09T04:52:08.810 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/048 2023-06-09T04:52:08.811 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:08.812 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:08.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:08.831 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-09T04:52:09.001 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:09.005 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:09.005 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:09.136 INFO:teuthology.orchestra.run.smithi026.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:09.140 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/049 2023-06-09T04:52:09.140 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/049 2023-06-09T04:52:09.140 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:09.142 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:09.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:09.173 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-09T04:52:09.346 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:09.350 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:09.350 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:09.489 INFO:teuthology.orchestra.run.smithi026.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:09.493 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/050 2023-06-09T04:52:09.493 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/050 2023-06-09T04:52:09.493 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:09.495 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:09.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:09.516 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-09T04:52:09.688 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:09.693 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:09.693 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:09.825 INFO:teuthology.orchestra.run.smithi026.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:09.828 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/051 2023-06-09T04:52:09.829 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/051 2023-06-09T04:52:09.829 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:09.831 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:09.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:09.854 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-09T04:52:10.025 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:10.030 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:10.030 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:10.163 INFO:teuthology.orchestra.run.smithi026.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:10.167 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/052 2023-06-09T04:52:10.167 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/052 2023-06-09T04:52:10.167 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:10.169 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:10.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:10.187 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-09T04:52:10.359 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:10.363 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:10.363 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:10.496 INFO:teuthology.orchestra.run.smithi026.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:10.500 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/053 2023-06-09T04:52:10.500 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/053 2023-06-09T04:52:10.500 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:10.502 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:10.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:10.525 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-09T04:52:10.695 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:10.700 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:10.700 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:10.832 INFO:teuthology.orchestra.run.smithi026.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:10.836 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/054 2023-06-09T04:52:10.836 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/054 2023-06-09T04:52:10.836 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:10.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:10.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:10.861 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-09T04:52:11.032 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:11.037 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:11.037 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:11.172 INFO:teuthology.orchestra.run.smithi026.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:11.176 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/055 2023-06-09T04:52:11.176 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/055 2023-06-09T04:52:11.176 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:11.178 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:11.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:11.197 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-09T04:52:11.368 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:11.372 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:11.373 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:11.518 INFO:teuthology.orchestra.run.smithi026.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:11.521 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/056 2023-06-09T04:52:11.521 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/056 2023-06-09T04:52:11.521 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:11.523 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:11.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:11.540 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-09T04:52:11.711 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:11.715 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:11.716 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:11.864 INFO:teuthology.orchestra.run.smithi026.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:11.867 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/057 2023-06-09T04:52:11.867 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/057 2023-06-09T04:52:11.867 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:11.869 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:11.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:11.895 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-09T04:52:12.069 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:12.073 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:12.073 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:13.058 INFO:teuthology.orchestra.run.smithi026.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:52:13.061 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/058 2023-06-09T04:52:13.062 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/058 2023-06-09T04:52:13.062 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:13.064 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:13.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:13.091 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-09T04:52:13.565 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:13.569 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:13.569 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:13.713 INFO:teuthology.orchestra.run.smithi026.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:13.716 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/059 2023-06-09T04:52:13.716 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/059 2023-06-09T04:52:13.717 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:13.718 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:13.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:13.744 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-09T04:52:13.918 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:13.922 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:13.922 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:14.896 INFO:teuthology.orchestra.run.smithi026.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:52:14.900 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/060 2023-06-09T04:52:14.900 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/060 2023-06-09T04:52:14.900 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:14.902 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:14.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:14.948 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-09T04:52:15.399 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:15.403 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:15.404 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:16.370 INFO:teuthology.orchestra.run.smithi026.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:52:16.374 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/061 2023-06-09T04:52:16.374 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/061 2023-06-09T04:52:16.374 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:16.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:16.399 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-09T04:52:16.864 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:16.868 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:16.868 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:17.002 INFO:teuthology.orchestra.run.smithi026.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:17.005 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/062 2023-06-09T04:52:17.005 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/062 2023-06-09T04:52:17.005 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:17.007 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:17.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:17.025 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-09T04:52:17.198 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:17.202 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:17.202 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:18.220 INFO:teuthology.orchestra.run.smithi026.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:52:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/063 2023-06-09T04:52:18.224 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/063 2023-06-09T04:52:18.225 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:18.226 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:18.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:18.244 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-09T04:52:18.721 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:18.725 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:18.725 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:18.857 INFO:teuthology.orchestra.run.smithi026.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:18.861 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/064 2023-06-09T04:52:18.861 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/064 2023-06-09T04:52:18.861 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:18.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:18.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:18.892 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-09T04:52:19.062 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:19.066 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:19.066 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:19.212 INFO:teuthology.orchestra.run.smithi026.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:19.215 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/065 2023-06-09T04:52:19.215 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/065 2023-06-09T04:52:19.215 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:19.217 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:19.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:19.240 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-09T04:52:19.413 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:19.417 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:19.417 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:19.562 INFO:teuthology.orchestra.run.smithi026.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:19.566 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/066 2023-06-09T04:52:19.566 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/066 2023-06-09T04:52:19.566 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:19.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:19.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:19.601 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-09T04:52:19.774 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:19.778 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:19.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:19.933 INFO:teuthology.orchestra.run.smithi026.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:19.936 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/067 2023-06-09T04:52:19.937 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/067 2023-06-09T04:52:19.937 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:19.939 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:19.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:19.960 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-09T04:52:20.133 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:20.137 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:20.137 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:20.283 INFO:teuthology.orchestra.run.smithi026.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:20.286 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/068 2023-06-09T04:52:20.287 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/068 2023-06-09T04:52:20.287 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:20.289 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:20.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:20.311 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-09T04:52:20.483 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:20.488 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:20.488 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:20.624 INFO:teuthology.orchestra.run.smithi026.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:52:20.628 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/069 2023-06-09T04:52:20.628 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/069 2023-06-09T04:52:20.628 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:52:20.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:20.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:20.650 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-09T04:52:20.822 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:52:20.826 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:20.826 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:52:37.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:37.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:08.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:08.235 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:19.571 INFO:teuthology.orchestra.run.smithi026.stdout:generic/070 59s 2023-06-09T04:53:19.576 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/070 2023-06-09T04:53:19.576 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:53:19.578 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:19.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:19.602 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-09T04:53:20.083 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:20.087 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:20.087 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:20.221 INFO:teuthology.orchestra.run.smithi026.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:53:20.224 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/071 2023-06-09T04:53:20.224 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/071 2023-06-09T04:53:20.225 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:53:20.226 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:20.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:20.243 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-09T04:53:20.414 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:20.419 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:20.420 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:22.249 INFO:teuthology.orchestra.run.smithi026.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:53:22.257 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/072 2023-06-09T04:53:22.258 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/072 2023-06-09T04:53:22.258 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:53:22.260 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:22.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:22.281 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-09T04:53:22.596 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:22.605 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:22.605 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:22.869 INFO:teuthology.orchestra.run.smithi026.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:53:22.877 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/073 2023-06-09T04:53:22.877 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/073 2023-06-09T04:53:22.877 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T04:53:22.879 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:22.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:22.901 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-09T04:53:23.193 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:23.197 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:23.197 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T04:53:38.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:38.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:08.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:08.673 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:38.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:38.923 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:09.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:09.152 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:39.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:39.330 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:09.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:09.433 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:39.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:39.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:10.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:10.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:40.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:40.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:10.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:10.426 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:37.736 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-06-09T04:58:37.733+0000 7f0df0c93700 -1 bdev(0x55c3406ce000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2023-06-09T04:58:40.579 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:40.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:10.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:10.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:40.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:40.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:11.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:11.093 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:41.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:41.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:11.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:11.499 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:41.742 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:41.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:12.055 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:12.058 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:42.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:42.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:12.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:12.379 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:42.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:42.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:12.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:12.996 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:43.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:43.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:13.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:13.914 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:44.047 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:44.050 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:14.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:14.242 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:44.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:44.399 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:14.566 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:14.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:44.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:44.794 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:15.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:15.014 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:45.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:45.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:15.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:15.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:45.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:45.415 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:15.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:15.576 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:45.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:45.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:15.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:15.876 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:46.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:46.104 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:16.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:16.314 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:46.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:46.538 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:16.643 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:16.647 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:46.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:46.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:17.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:17.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:47.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:47.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:17.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:17.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:47.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:47.946 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:18.149 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:18.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:48.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:48.485 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:18.913 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:18.915 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:49.289 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:49.292 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:19.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:19.430 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:49.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:49.549 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:20.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:20.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:50.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:50.144 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:03.479 INFO:teuthology.orchestra.run.smithi026.stdout:generic/074 1600s 2023-06-09T05:20:03.513 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/074 2023-06-09T05:20:03.513 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:03.515 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:03.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:03.534 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-09T05:20:04.185 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:04.189 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:04.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:20.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:20.232 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:43.913 INFO:teuthology.orchestra.run.smithi026.stdout:generic/075 39s 2023-06-09T05:20:43.918 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/075 2023-06-09T05:20:43.918 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:43.920 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:43.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:43.945 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-09T05:20:44.459 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:44.463 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:44.464 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:44.597 INFO:teuthology.orchestra.run.smithi026.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:44.601 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/076 2023-06-09T05:20:44.601 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/076 2023-06-09T05:20:44.601 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:44.603 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:44.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:44.619 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-09T05:20:44.792 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:44.796 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:44.796 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:47.295 INFO:teuthology.orchestra.run.smithi026.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:47.298 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/077 2023-06-09T05:20:47.299 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/077 2023-06-09T05:20:47.299 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:47.301 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:47.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:47.318 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-09T05:20:47.493 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:47.497 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:47.497 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:47.668 INFO:teuthology.orchestra.run.smithi026.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-09T05:20:47.672 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/078 2023-06-09T05:20:47.672 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/078 2023-06-09T05:20:47.672 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:47.674 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:47.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:47.695 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-09T05:20:48.207 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:48.211 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:48.211 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:48.651 INFO:teuthology.orchestra.run.smithi026.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-09T05:20:48.655 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/079 2023-06-09T05:20:48.655 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/079 2023-06-09T05:20:48.655 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:48.657 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:48.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:48.681 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-09T05:20:48.861 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:48.865 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:48.865 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:50.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:50.312 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:51.053 INFO:teuthology.orchestra.run.smithi026.stdout:generic/080 3s 2023-06-09T05:20:51.059 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/080 2023-06-09T05:20:51.059 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:51.061 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:51.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:51.087 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-09T05:20:51.270 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:51.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:51.414 INFO:teuthology.orchestra.run.smithi026.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:51.417 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/081 2023-06-09T05:20:51.418 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/081 2023-06-09T05:20:51.418 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:51.420 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:51.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:51.441 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-09T05:20:51.613 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:51.617 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:51.617 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:51.754 INFO:teuthology.orchestra.run.smithi026.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:51.757 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/082 2023-06-09T05:20:51.758 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/082 2023-06-09T05:20:51.758 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:51.760 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:51.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:51.791 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-09T05:20:51.966 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:51.970 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:51.970 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:52.104 INFO:teuthology.orchestra.run.smithi026.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:52.108 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/083 2023-06-09T05:20:52.108 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/083 2023-06-09T05:20:52.108 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:52.110 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:52.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:52.135 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-09T05:20:52.309 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:52.314 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:52.314 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:52.447 INFO:teuthology.orchestra.run.smithi026.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:52.451 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/084 2023-06-09T05:20:52.451 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/084 2023-06-09T05:20:52.451 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:52.453 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:52.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:52.469 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-09T05:20:52.645 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:52.649 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:52.649 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:52.819 INFO:teuthology.orchestra.run.smithi026.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:20:52.822 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/085 2023-06-09T05:20:52.823 INFO:teuthology.orchestra.run.smithi026.stdout:Not run: generic/085 2023-06-09T05:20:52.823 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:52.824 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:52.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:52.847 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-09T05:20:53.021 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:53.025 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:generic/086 5s 2023-06-09T05:20:58.119 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/086 2023-06-09T05:20:58.120 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:58.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:58.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:58.232 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-09T05:20:59.297 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:20:59.301 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:20:59.302 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:59.676 INFO:teuthology.orchestra.run.smithi026.stdout:generic/087 0s 2023-06-09T05:20:59.681 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/087 2023-06-09T05:20:59.681 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:20:59.683 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:20:59.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:59.698 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-09T05:21:00.213 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:21:00.217 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:21:00.218 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:21:00.402 INFO:teuthology.orchestra.run.smithi026.stdout:generic/088 0s 2023-06-09T05:21:00.407 INFO:teuthology.orchestra.run.smithi026.stdout:Ran: generic/088 2023-06-09T05:21:00.407 INFO:teuthology.orchestra.run.smithi026.stdout:Passed all 1 tests 2023-06-09T05:21:00.409 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:21:00.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:21:00.426 DEBUG:teuthology.orchestra.run.smithi026:> (cd /tmp/tmp.dLknDlhvfJxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-09T05:21:00.936 INFO:teuthology.orchestra.run.smithi026.stdout:FSTYP -- ceph-fuse 2023-06-09T05:21:00.940 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM -- Linux/x86_64 smithi026 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:21:00.941 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-06-09T05:21:20.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:20.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:51.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:51.594 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:21.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:21.665 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:51.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:51.727 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:21.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:21.797 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:51.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:51.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:21.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:21.955 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:52.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:52.026 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:22.091 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:22.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:52.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:52.171 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:22.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:22.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:52.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:52.313 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:22.394 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:22.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:52.467 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:52.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:22.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:22.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:52.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:52.600 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:22.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:22.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:52.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:52.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:22.826 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:22.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:52.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:52.893 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:22.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:22.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:53.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:53.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:23.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:23.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:53.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:53.192 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:23.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:23.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:53.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:53.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:23.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:23.427 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:53.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:53.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:23.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:23.592 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:53.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:53.653 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:23.727 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:23.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:53.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:53.836 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:23.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:23.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:53.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:53.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:24.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:24.054 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:54.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:54.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:24.199 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:24.202 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:54.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:54.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:24.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:24.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:54.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:54.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:24.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:24.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:54.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:54.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:24.670 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:24.673 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:54.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:54.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:24.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:24.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:54.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:54.909 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:25.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:25.009 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:55.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:55.083 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:25.151 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:25.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:55.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:55.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:25.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:25.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:55.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:55.413 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:25.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:25.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:55.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:55.607 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:25.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:25.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:55.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:55.768 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:25.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:25.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:55.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:55.905 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:25.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:25.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:56.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:56.053 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:26.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:26.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:56.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:56.211 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:26.272 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:26.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:56.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:56.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:26.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:26.462 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:56.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:56.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:26.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:26.587 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:56.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:56.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:26.739 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:26.742 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:56.818 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:56.821 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:26.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:26.891 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:56.977 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:56.980 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:27.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:27.044 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:57.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:57.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:27.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:27.190 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:57.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:57.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:27.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:27.332 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:57.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:57.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:27.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:27.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:57.572 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:57.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:27.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:27.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:57.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:57.718 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:27.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:27.783 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:57.851 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:57.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:27.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:27.915 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:57.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:57.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:28.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:28.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:58.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:58.150 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:28.234 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:28.237 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:58.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:58.307 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:28.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:28.368 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:58.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:58.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:28.556 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:28.559 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:58.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:58.631 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:28.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:28.715 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:58.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:58.785 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:28.862 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:28.865 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:58.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:58.937 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:28.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:28.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:59.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:59.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:29.149 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:29.153 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:59.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:59.235 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:29.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:29.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:59.367 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:59.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:29.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:29.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:59.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:59.521 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:29.592 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:29.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:59.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:59.695 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:29.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:29.789 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:59.857 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:59.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:29.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:29.953 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:00.027 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:00.030 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:30.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:30.093 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:00.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:00.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:30.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:30.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:00.356 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:00.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:30.430 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:30.433 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:00.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:00.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:30.572 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:30.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:00.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:00.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:30.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:30.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:01.088 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:01.091 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:31.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:31.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:01.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:01.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:31.431 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:31.433 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:01.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:01.588 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:31.712 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:31.715 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:01.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:01.835 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:31.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:31.972 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:02.097 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:02.100 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:32.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:32.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:02.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:02.541 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:32.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:32.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:02.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:02.756 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:32.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:32.817 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:02.959 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:02.962 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:33.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:33.107 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:03.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:03.227 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:33.352 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:33.354 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:03.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:03.427 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:33.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:33.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:03.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:03.648 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:33.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:33.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:03.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:03.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:33.979 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:33.982 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:04.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:04.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:34.177 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:34.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:04.272 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:04.275 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:34.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:34.412 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:04.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:04.548 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:34.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:34.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:04.818 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:04.821 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:34.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:34.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:05.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:05.111 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:35.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:35.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:05.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:05.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:35.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:35.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:05.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:05.557 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:35.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:35.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:05.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:05.699 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:35.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:35.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:06.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:06.004 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:36.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:36.157 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:06.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:06.310 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:36.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:36.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:06.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:06.566 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:36.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:36.712 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:06.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:06.840 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:36.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:37.001 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:07.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:07.129 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:37.272 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:37.275 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:07.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:07.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:37.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:37.490 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:07.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:07.557 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:37.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:37.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:07.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:07.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:37.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:37.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:08.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:08.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:38.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:38.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:08.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:08.296 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:38.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:38.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:08.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:08.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:38.705 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:38.708 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:08.774 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:08.777 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:38.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:38.931 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:09.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:09.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:39.177 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:39.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:09.330 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:09.333 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:39.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:39.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:09.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:09.553 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:39.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:39.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:09.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:09.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:39.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:39.802 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:09.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:09.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:40.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:40.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:10.198 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:10.202 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:40.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:40.322 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:10.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:10.476 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:40.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:40.544 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:10.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:10.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:40.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:40.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:10.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:10.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:41.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:41.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:11.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:11.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:41.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:41.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:11.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:11.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:41.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:41.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:11.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:11.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:41.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:41.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:11.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:11.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:42.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:42.052 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:12.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:12.136 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:42.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:42.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:12.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:12.330 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:42.398 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:42.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:12.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:12.535 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:42.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:42.654 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:12.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:12.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:42.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:42.936 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:13.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:13.083 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:43.216 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:43.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:13.362 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:13.364 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:43.490 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:43.492 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:13.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:13.620 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:43.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:43.757 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:13.866 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:13.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:43.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:43.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:14.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:14.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:44.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:44.211 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:14.277 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:14.280 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:44.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:44.368 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:14.486 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:14.489 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:44.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:44.633 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:14.767 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:14.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:44.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:44.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:15.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:15.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:45.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:45.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:15.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:15.300 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:45.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:45.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:15.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:15.490 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:45.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:45.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:15.778 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:15.781 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:45.923 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:45.926 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:16.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:16.054 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:46.115 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:46.119 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:16.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:16.261 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:46.335 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:46.339 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:16.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:16.409 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:46.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:46.554 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:16.679 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:16.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:46.816 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:46.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:16.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:16.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:46.956 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:46.959 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:17.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:17.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:47.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:47.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:17.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:17.183 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:47.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:47.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:17.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:17.457 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:47.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:47.586 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:17.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:17.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:47.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:47.876 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:17.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:17.940 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:48.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:48.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:18.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:18.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:18.247 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-06-09T07:33:18.243+0000 7f681875b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 242125) UID: 0 2023-06-09T07:33:18.247 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-06-09T07:33:18.243+0000 7f0e100e7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 242125) UID: 0 2023-06-09T07:33:18.248 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-06-09T07:33:18.243+0000 7f8ec5e68700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 242125) UID: 0 2023-06-09T07:33:18.248 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-06-09T07:33:18.243+0000 7fa51b1a6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 242125) UID: 0 2023-06-09T07:35:35.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:35.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:05.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:05.530 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:35.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:35.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:05.834 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:05.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:35.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:35.973 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:06.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:06.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:36.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:36.230 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:06.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:06.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:36.449 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:36.452 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:06.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:06.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:36.739 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:36.742 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:06.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:06.896 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:36.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:36.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:07.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:07.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:37.129 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:37.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:07.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:07.216 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:37.358 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:37.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:07.478 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:07.480 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:37.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:37.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:07.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:07.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:37.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:37.915 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:08.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:08.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:38.185 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:38.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:08.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:08.341 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:38.392 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:38.395 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:08.520 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:08.523 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:38.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:38.659 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:08.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:08.795 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:38.929 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:38.931 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:09.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:09.043 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:39.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:39.121 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:09.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:09.233 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:39.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:39.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:09.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:09.557 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:39.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:39.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:09.818 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:09.821 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:39.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:39.974 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:10.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:10.039 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:40.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:40.181 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:10.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:10.250 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:40.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:40.396 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:10.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:10.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:40.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:40.677 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:10.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:10.856 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:41.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:41.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:11.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:11.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:41.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:41.234 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:11.384 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:11.387 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:41.454 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:41.457 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:11.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:11.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:41.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:41.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:11.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:11.833 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:41.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:42.002 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:12.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:12.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:42.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:42.217 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:12.342 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:12.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:42.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:42.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:12.622 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:12.625 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:42.727 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:42.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:12.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:12.875 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:43.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:43.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:13.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:13.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:43.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:43.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:13.444 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:13.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:43.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:43.608 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:13.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:13.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:43.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:43.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:14.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:14.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:44.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:44.147 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:14.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:14.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:44.335 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:44.337 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:14.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:14.483 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:44.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:44.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:14.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:14.806 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:44.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:44.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:15.084 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:15.086 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:45.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:45.215 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:15.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:15.368 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:45.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:45.506 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:15.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:15.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:45.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:45.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:15.845 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:15.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:45.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:45.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:16.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:16.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:46.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:46.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:16.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:16.273 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:46.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:46.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:16.414 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:16.417 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:46.535 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:46.538 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:16.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:16.876 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:46.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:46.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:17.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:17.040 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:47.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:47.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:17.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:17.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:47.414 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:47.417 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:17.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:17.570 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:47.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:47.698 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:17.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:17.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:47.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:47.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:18.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:18.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:48.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:48.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:18.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:18.185 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:48.341 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:48.344 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:18.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:18.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:48.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:48.508 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:18.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:18.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:48.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:48.790 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:18.856 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:18.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:49.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:49.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:19.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:19.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:49.292 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:49.295 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:19.362 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:19.365 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:49.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:49.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:19.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:19.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:49.805 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:49.807 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:19.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:19.961 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:50.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:50.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:20.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:20.242 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:50.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:50.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:20.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:20.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:50.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:50.578 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:20.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:20.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:50.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:50.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:20.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:20.912 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:50.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:50.974 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:21.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:21.095 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:51.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:51.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:21.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:21.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:51.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:51.462 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:21.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:21.607 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:51.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:51.701 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:21.774 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:21.777 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:51.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:51.908 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:21.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:21.972 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:52.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:52.115 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:22.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:22.276 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:52.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:52.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:22.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:22.541 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:52.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:52.677 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:22.761 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:22.764 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:52.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:52.908 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:22.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:22.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:53.136 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:53.139 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:23.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:23.327 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:53.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:53.396 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:23.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:23.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:53.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:53.644 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:23.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:23.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:53.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:53.867 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:23.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:23.979 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:54.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:54.115 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:24.249 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:24.252 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:54.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:54.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:24.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:24.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:54.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:54.611 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:24.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:24.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:54.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:54.793 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:24.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:24.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:55.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:55.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:25.132 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:25.134 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:55.252 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:55.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:25.388 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:25.391 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:55.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:55.535 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:25.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:25.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:55.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:55.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:25.882 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:25.885 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:55.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:55.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:26.090 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:26.093 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:56.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:56.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:26.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:26.358 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:56.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:56.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:26.636 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:26.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:56.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:56.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:26.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:26.812 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:56.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:56.891 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:27.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:27.027 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:57.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:57.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:27.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:27.308 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:57.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:57.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:27.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:27.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:57.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:57.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:27.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:27.820 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:57.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:57.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:27.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:27.951 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:58.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:58.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:28.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:28.101 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:58.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:58.195 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:28.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:28.331 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:58.482 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:58.485 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:28.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:28.605 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:58.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:58.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:28.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:28.894 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:59.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:59.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:29.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:29.185 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:59.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:59.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:29.330 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:29.333 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:59.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:59.493 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:29.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:29.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:59.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:59.699 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:29.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:29.828 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:59.986 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:59.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:30.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:30.117 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:00.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:00.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:30.421 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:30.424 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:00.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:00.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:30.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:30.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:00.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:00.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:31.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:31.061 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:01.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:01.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:31.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:31.336 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:01.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:01.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:31.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:31.592 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:01.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:01.677 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:31.828 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:31.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:01.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:01.976 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:32.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:32.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:02.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:02.107 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:32.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:32.259 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:02.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:02.387 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:32.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:32.534 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:02.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:02.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:32.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:32.814 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:03.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:03.050 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:33.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:33.186 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:03.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:03.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:33.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:33.343 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:03.468 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:03.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:33.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:33.616 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:03.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:03.702 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:33.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:33.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:03.990 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:03.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:34.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:34.054 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:04.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:04.200 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:34.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:34.268 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:04.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:04.331 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:34.431 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:34.434 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:04.587 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:04.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:34.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:34.699 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:04.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:04.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:34.911 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:34.914 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:05.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:05.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:35.201 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:35.204 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:05.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:05.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:35.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:35.528 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:05.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:05.648 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:35.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:35.784 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:05.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:05.922 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:36.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:36.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:06.200 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:06.202 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:36.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:36.322 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:06.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:06.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:36.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:36.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:06.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:06.607 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:36.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:36.701 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:06.844 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:06.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:36.997 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:37.000 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:07.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:07.145 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:37.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:37.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:07.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:07.418 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:37.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:37.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:07.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:07.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:37.834 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:37.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:08.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:08.174 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:38.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:38.260 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:08.419 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:08.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:38.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:38.500 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:08.566 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:08.569 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:38.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:38.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:08.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:08.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:38.842 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:38.845 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:08.987 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:08.990 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:39.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:39.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:09.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:09.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:39.348 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:39.350 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:09.417 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:09.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:39.537 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:39.540 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:09.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:09.621 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:39.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:39.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:09.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:09.849 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:39.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:39.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:10.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:10.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:40.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:40.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:10.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:10.654 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:40.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:40.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:10.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:10.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:41.084 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:41.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:11.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:11.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:41.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:41.256 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:11.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:11.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:41.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:41.409 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:11.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:11.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:41.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:41.562 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:11.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:11.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:41.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:41.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:11.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:11.896 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:42.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:42.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:12.086 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:12.089 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:42.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:42.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:12.341 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:12.343 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:42.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:42.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:12.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:12.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:42.808 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:42.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:12.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:12.881 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:43.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:43.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:13.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:13.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:43.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:43.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:13.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:13.427 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:43.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:43.515 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:13.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:13.659 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:43.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:43.743 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:13.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:13.816 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:43.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:43.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:14.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:14.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:44.199 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:44.201 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:14.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:14.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:44.331 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:44.334 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:14.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:14.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:44.478 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:44.481 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:14.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:14.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:44.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:44.622 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:14.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:14.758 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:44.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:44.835 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:14.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:14.898 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:44.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:44.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:15.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:15.055 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:45.238 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:45.241 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:15.392 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:15.395 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:45.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:45.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:15.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:15.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:45.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:45.712 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:15.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:15.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:45.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:45.961 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:16.021 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:16.024 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:46.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:46.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:16.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:16.173 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:46.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:46.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:16.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:16.328 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:46.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:46.400 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:16.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:16.461 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:46.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:46.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:16.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:16.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:46.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:46.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:16.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:16.736 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:46.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:46.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:16.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:16.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:46.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:46.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:17.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:17.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:47.117 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:47.119 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:17.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:17.183 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:47.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:47.255 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:17.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:17.321 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:47.388 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:47.391 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:17.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:17.469 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:47.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:47.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:17.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:17.600 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:47.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:47.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:17.850 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:17.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:47.916 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:47.919 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:18.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:18.005 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:48.075 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:48.078 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:18.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:18.137 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:48.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:48.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:18.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:18.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:48.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:48.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:18.431 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:18.434 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:48.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:48.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:18.572 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:18.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:48.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:48.661 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:18.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:18.735 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:48.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:48.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:18.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:18.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:48.932 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:48.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:18.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:18.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:49.069 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:49.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:19.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:19.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:49.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:49.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:19.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:19.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:49.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:49.451 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:19.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:19.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:49.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:49.709 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:19.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:19.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:49.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:49.940 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:20.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:20.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:50.141 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:50.144 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:20.256 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:20.259 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:50.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:50.336 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:20.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:20.398 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:50.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:50.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:20.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:20.695 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:50.829 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:50.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:20.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:20.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:51.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:51.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:21.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:21.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:51.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:51.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:21.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:21.539 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:51.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:51.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:21.693 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:21.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:51.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:51.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:21.833 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:21.836 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:51.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:51.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:21.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:21.968 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:52.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:52.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:22.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:22.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:52.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:52.195 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:22.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:22.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:52.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:52.350 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:22.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:22.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:52.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:52.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:22.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:22.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:52.794 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:52.797 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:22.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:22.885 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:53.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:53.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:23.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:23.317 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:53.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:53.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:23.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:23.514 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:53.595 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:53.597 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:23.665 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:23.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:53.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:53.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:23.800 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:23.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:53.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:53.874 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:23.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:23.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:54.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:54.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:24.096 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:24.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:54.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:54.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:24.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:24.227 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:54.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:54.308 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:24.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:24.379 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:54.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:54.454 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:24.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:24.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:54.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:54.598 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:24.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:24.657 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:54.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:54.724 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:24.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:24.804 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:54.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:54.876 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:24.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:24.940 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:55.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:55.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:25.083 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:25.086 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:55.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:55.164 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:25.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:25.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:55.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:55.312 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:25.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:25.450 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:55.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:55.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:25.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:25.672 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:55.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:55.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:25.800 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:25.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:55.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:55.873 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:25.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:25.937 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:56.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:56.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:26.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:26.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:56.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:56.145 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:26.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:26.215 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:56.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:56.301 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:26.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:26.362 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:56.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:56.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:26.490 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:26.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:56.567 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:56.570 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:26.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:26.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:56.727 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:56.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:26.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:26.881 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:57.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:57.027 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:27.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:27.179 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:57.241 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:57.244 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:27.384 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:27.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:57.460 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:57.463 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:27.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:27.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:57.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:57.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:27.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:27.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:57.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:57.910 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:28.021 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:28.023 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:58.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:58.186 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:28.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:28.313 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:58.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:58.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:28.517 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:28.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:58.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:58.606 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:28.690 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:28.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:58.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:58.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:28.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:28.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:59.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:59.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:29.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:29.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:59.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:59.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:29.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:29.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:59.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:59.408 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:29.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:29.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:59.541 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:59.544 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:29.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:29.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:59.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:59.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:29.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:29.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:59.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:59.824 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:29.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:29.905 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:59.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:59.968 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:30.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:30.109 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:00.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:00.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:30.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:30.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:00.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:00.459 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:30.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:30.588 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:00.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:00.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:30.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:30.827 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:00.961 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:00.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:31.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:31.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:01.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:01.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:31.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:31.390 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:01.534 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:01.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:31.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:31.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:01.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:01.840 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:31.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:31.985 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:02.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:02.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:32.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:32.225 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:02.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:02.395 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:32.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:32.549 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:02.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:02.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:32.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:32.796 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:03.055 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:03.058 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:33.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:33.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:03.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:03.314 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:33.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:33.450 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:03.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:03.620 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:33.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:33.756 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:03.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:03.909 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:34.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:34.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:04.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:04.174 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:34.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:34.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:04.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:04.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:34.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:34.591 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:04.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:04.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:34.836 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:34.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:04.948 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:04.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:35.076 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:35.079 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:05.205 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:05.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:35.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:35.278 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:05.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:05.343 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:35.413 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:35.416 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:05.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:05.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:35.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:35.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:05.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:05.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:35.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:35.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:05.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:05.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:35.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:35.840 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:05.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:05.937 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:36.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:36.009 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:06.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:06.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:36.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:36.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:06.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:06.503 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:36.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:36.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:06.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:06.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:36.876 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:36.879 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:07.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:07.023 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:37.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:37.185 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:07.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:07.312 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:37.454 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:37.457 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:07.599 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:07.602 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:37.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:37.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:07.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:07.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:37.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:37.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:07.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:07.883 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:37.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:37.946 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:08.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:08.006 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:38.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:38.069 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:08.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:08.146 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:38.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:38.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:08.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:08.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:38.350 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:38.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:08.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:08.417 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:38.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:38.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:08.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:08.558 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:38.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:38.637 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:08.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:08.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:38.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:38.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:08.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:08.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:38.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:38.922 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:08.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:09.002 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:39.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:39.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:09.152 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:09.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:39.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:39.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:09.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:09.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:39.444 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:39.447 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:09.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:09.521 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:39.574 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:39.577 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:09.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:09.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:39.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:39.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:09.799 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:09.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:39.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:39.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:09.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:09.947 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:40.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:40.104 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:10.187 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:10.190 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:40.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:40.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:10.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:10.430 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:40.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:40.566 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:10.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:10.631 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:40.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:40.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:10.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:10.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:40.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:40.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:10.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:10.945 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:41.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:41.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:11.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:11.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:41.144 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:41.147 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:11.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:11.211 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:41.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:41.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:11.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:11.342 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:41.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:41.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:11.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:11.665 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:41.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:41.818 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:11.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:11.902 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:41.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:41.967 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:12.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:12.037 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:42.089 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:42.092 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:12.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:12.198 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:42.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:42.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:12.331 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:12.333 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:42.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:42.426 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:12.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:12.621 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:42.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:42.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:12.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:12.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:42.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:42.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:12.932 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:12.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:43.017 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:43.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:13.084 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:13.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:43.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:43.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:13.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:13.256 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:43.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:43.367 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:13.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:13.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:43.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:43.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:13.799 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:13.802 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:43.944 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:43.947 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:14.055 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:14.058 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:44.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:44.195 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:14.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:14.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:44.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:44.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:14.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:14.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:44.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:44.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:14.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:14.714 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:44.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:44.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:14.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:14.959 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:45.075 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:45.078 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:15.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:15.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:45.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:45.351 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:15.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:15.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:45.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:45.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:15.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:15.778 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:45.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:45.915 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:16.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:16.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:46.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:46.137 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:16.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:16.282 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:46.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:46.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:16.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:16.508 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:46.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:46.578 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:16.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:16.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:46.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:46.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:16.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:16.988 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:47.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:47.133 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:17.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:17.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:47.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:47.322 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:17.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:17.410 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:47.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:47.554 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:17.679 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:17.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:47.807 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:47.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:17.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:17.963 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:48.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:48.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:18.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:18.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:48.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:48.356 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:18.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:18.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:48.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:48.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:18.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:18.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:48.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:48.994 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:19.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:19.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:49.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:49.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:19.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:19.269 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:49.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:49.398 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:19.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:19.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:49.644 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:49.647 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:19.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:19.724 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:49.858 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:49.861 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:20.011 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:20.014 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:50.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:50.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:20.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:20.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:50.395 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:50.398 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:20.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:20.553 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:50.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:50.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:20.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:20.849 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:50.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:50.910 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:21.028 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:21.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:51.174 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:51.176 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:21.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:21.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:51.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:51.458 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:21.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:21.578 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:51.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:51.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:21.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:21.796 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:51.857 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:51.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:21.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:21.924 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:52.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:52.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:22.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:22.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:52.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:52.150 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:22.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:22.221 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:52.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:52.282 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:22.362 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:22.365 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:52.444 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:52.447 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:22.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:22.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:52.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:52.580 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:22.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:22.652 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:52.714 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:52.717 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:22.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:22.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:52.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:52.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:22.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:22.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:52.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:52.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:23.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:23.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:53.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:53.157 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:23.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:23.258 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:53.317 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:53.320 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:23.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:23.390 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:53.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:53.454 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:23.515 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:23.518 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:53.596 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:53.599 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:23.668 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:23.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:53.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:53.743 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:23.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:23.824 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:53.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:53.952 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:24.069 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:24.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:54.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:54.218 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:24.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:24.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:54.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:54.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:24.490 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:24.492 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:54.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:54.621 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:24.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:24.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:54.875 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:54.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:24.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:24.954 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:55.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:55.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:25.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:25.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:55.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:55.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:25.474 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:25.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:55.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:55.539 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:25.664 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:25.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:55.808 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:55.811 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:25.945 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:25.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:56.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:56.084 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:26.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:26.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:56.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:56.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:26.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:26.435 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:56.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:56.554 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:26.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:26.691 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:56.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:56.827 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:26.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:26.972 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:57.040 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:57.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:27.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:27.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:57.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:57.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:27.457 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:27.459 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:57.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:57.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:27.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:27.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:57.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:57.902 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:27.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:28.002 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:58.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:58.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:28.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:28.137 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:58.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:58.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:28.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:28.266 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:58.328 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:58.331 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:28.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:28.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:58.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:58.486 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:28.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:28.564 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:58.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:58.651 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:28.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:28.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:58.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:58.790 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:28.868 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:28.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:58.935 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:58.938 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:29.014 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:29.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:59.144 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:59.146 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:29.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:29.216 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:59.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:59.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:29.478 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:29.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:59.640 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:59.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:29.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:29.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:59.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:59.773 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:29.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:29.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:00.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:00.114 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:30.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:30.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:00.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:00.341 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:30.402 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:30.405 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:00.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:00.468 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:30.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:30.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:00.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:00.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:30.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:30.719 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:00.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:00.783 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:30.852 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:30.855 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:00.984 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:00.987 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:31.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:31.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:01.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:01.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:31.444 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:31.447 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:01.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:01.516 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:31.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:31.691 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:01.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:01.793 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:31.932 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:31.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:02.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:02.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:32.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:32.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:02.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:02.260 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:32.394 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:32.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:02.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:02.468 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:32.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:32.541 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:02.661 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:02.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:32.806 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:32.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:02.876 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:02.879 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:32.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:32.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:03.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:03.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:33.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:33.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:03.429 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:03.432 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:33.566 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:33.569 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:03.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:03.698 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:33.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:33.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:03.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:03.910 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:34.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:34.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:04.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:04.168 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:34.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:34.292 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:04.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:04.400 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:34.470 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:34.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:04.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:04.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:34.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:34.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:04.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:04.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:35.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:35.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:05.207 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:05.210 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:35.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:35.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:05.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:05.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:35.592 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:35.594 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:05.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:05.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:35.857 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:35.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:05.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:05.926 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:35.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:35.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:06.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:06.071 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:36.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:36.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:36.200 INFO:tasks.ceph.osd.6.smithi104.stderr:2023-06-09T14:28:36.198+0000 7fee01188700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 169295) UID: 0 2023-06-09T14:28:36.201 INFO:tasks.ceph.osd.4.smithi104.stderr:2023-06-09T14:28:36.198+0000 7f6d88c6a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 169295) UID: 0 2023-06-09T14:28:36.201 INFO:tasks.ceph.osd.7.smithi104.stderr:2023-06-09T14:28:36.198+0000 7f877f13d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 169295) UID: 0 2023-06-09T14:28:36.201 INFO:tasks.ceph.osd.5.smithi104.stderr:2023-06-09T14:28:36.198+0000 7fa77512e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 169295) UID: 0 2023-06-09T14:30:44.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:44.449 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:14.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:14.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:44.579 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:44.582 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:14.643 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:14.645 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:44.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:44.719 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:14.795 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:14.797 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:44.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:44.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:14.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:14.945 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:45.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:45.023 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:15.083 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:15.086 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:45.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:45.157 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:15.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:15.217 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:45.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:45.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:15.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:15.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:45.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:45.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:15.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:15.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:45.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:45.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:15.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:15.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:45.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:45.768 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:15.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:15.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:45.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:45.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:16.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:16.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:46.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:46.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:16.139 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:16.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:46.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:46.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:16.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:16.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:46.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:46.410 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:16.485 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:16.490 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:46.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:46.567 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:16.627 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:16.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:46.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:46.714 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:16.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:16.779 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:46.845 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:46.850 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:16.907 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:16.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:46.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:47.000 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:17.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:17.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:47.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:47.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:17.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:17.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:47.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:47.298 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:17.358 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:17.362 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:47.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:47.435 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:17.495 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:17.498 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:47.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:47.563 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:17.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:17.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:47.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:47.702 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:17.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:17.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:47.840 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:47.843 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:17.901 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:17.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:47.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:47.996 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:18.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:18.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:48.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:48.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:18.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:18.225 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:48.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:48.286 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:18.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:18.350 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:48.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:48.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:18.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:18.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:48.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:48.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:18.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:18.695 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:48.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:48.761 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:18.822 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:18.825 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:48.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:48.922 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:18.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:18.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:49.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:49.150 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:19.237 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:19.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:49.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:49.317 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:19.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:19.383 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:49.460 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:49.463 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:19.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:19.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:49.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:49.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:19.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:19.676 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:49.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:49.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:19.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:19.823 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:49.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:49.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:19.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:19.963 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:50.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:50.053 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:20.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:20.118 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:50.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:50.191 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:20.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:20.254 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:50.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:50.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:20.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:20.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:50.477 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:50.480 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:20.540 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:20.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:50.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:50.616 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:20.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:20.680 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:50.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:50.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:20.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:20.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:50.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:50.906 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:20.974 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:20.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:51.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:51.055 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:21.114 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:21.117 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:51.190 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:51.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:21.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:21.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:51.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:51.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:21.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:21.413 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:51.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:51.500 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:21.553 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:21.556 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:51.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:51.628 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:51.684 INFO:tasks.ceph.osd.6.smithi104.stderr:2023-06-09T15:18:51.680+0000 7fee01188700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171770) UID: 0 2023-06-09T15:18:51.684 INFO:tasks.ceph.osd.4.smithi104.stderr:2023-06-09T15:18:51.680+0000 7f6d88c6a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171770) UID: 0 2023-06-09T15:18:51.685 INFO:tasks.ceph.osd.7.smithi104.stderr:2023-06-09T15:18:51.680+0000 7f877f13d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171770) UID: 0 2023-06-09T15:18:51.685 INFO:tasks.ceph.osd.5.smithi104.stderr:2023-06-09T15:18:51.680+0000 7fa77512e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171770) UID: 0 2023-06-09T15:21:01.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:01.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:31.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:31.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:01.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:01.804 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:31.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:31.958 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:02.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:02.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:32.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:32.222 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:02.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:02.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:32.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:32.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:02.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:02.665 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:32.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:32.735 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:02.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:02.880 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:33.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:33.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:03.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:03.137 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:33.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:33.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:03.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:03.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:33.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:33.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:03.621 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:03.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:33.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:33.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:03.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:03.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:33.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:33.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:04.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:04.052 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:34.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:34.173 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:04.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:04.309 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:34.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:34.368 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:04.505 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:04.507 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:34.585 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:34.589 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:04.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:04.660 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:34.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:34.740 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:04.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:04.812 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:34.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:34.868 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:04.938 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:04.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:35.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:35.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:05.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:05.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:35.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:35.149 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:05.228 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:05.231 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:35.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:35.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:05.359 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:05.363 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:35.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:35.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:05.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:05.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:35.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:35.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:05.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:05.652 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:35.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:35.711 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:05.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:05.784 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:35.844 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:35.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:05.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:05.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:35.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:35.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:06.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:06.056 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:36.129 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:36.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:06.207 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:06.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:36.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:36.273 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:06.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:06.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:36.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:36.412 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:06.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:06.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:36.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:36.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:06.615 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:06.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:36.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:36.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:06.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:06.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:36.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:36.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:06.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:06.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:37.036 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:37.039 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:07.108 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:07.111 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:37.174 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:37.177 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:07.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:07.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:37.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:37.443 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:07.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:07.596 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:37.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:37.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:07.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:07.994 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:38.069 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:38.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:08.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:08.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:38.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:38.308 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:08.428 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:08.431 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:38.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:38.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:08.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:08.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:38.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:38.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:09.019 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:09.022 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:39.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:39.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:09.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:09.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:39.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:39.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:09.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:09.303 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:39.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:39.364 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:09.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:09.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:39.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:39.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:09.621 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:09.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:39.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:39.727 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:09.869 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:09.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:39.956 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:39.959 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:10.083 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:10.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:40.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:40.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:10.415 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:10.418 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:40.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:40.580 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:10.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:10.700 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:40.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:40.761 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:10.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:10.827 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:40.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:40.906 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:10.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:10.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:41.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:41.033 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:11.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:11.119 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:41.177 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:41.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:11.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:11.258 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:41.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:41.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:11.417 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:11.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:41.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:41.486 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:11.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:11.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:41.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:41.637 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:11.706 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:11.709 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:41.795 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:41.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:11.858 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:11.861 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:41.922 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:41.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:12.003 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:12.006 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:42.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:42.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:12.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:12.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:42.362 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:42.365 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:12.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:12.435 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:42.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:42.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:12.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:12.761 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:42.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:42.894 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:13.036 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:13.039 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:43.156 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:43.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:13.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:13.271 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:43.421 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:43.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:13.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:13.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:43.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:43.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:13.698 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:13.701 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:43.852 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:43.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:04.207 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-09T16:23:04.334 DEBUG:teuthology.task.console_log:Killing console logger for smithi026 2023-06-09T16:23:04.335 DEBUG:teuthology.task.console_log:Killing console logger for smithi104 2023-06-09T16:23:04.335 DEBUG:teuthology.exit:Finished running handlers